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ABSTRACT 

„ T . technical appendix to "The Career intern Proaram- 

r^nijr'"'^''^?^^""^ Experiment in Career Education," ^olJSe l!" 

reports on the research designs used for evaluating the Career Intern 
s^n^r increasing the student's JogniU^e 

skills, academic achievement, vocational adjustment, future 
^fiJ?^^*^*"' self-image as compared to students who did not 

eva^i.i?o^%^''-^^'^* f''^^^^ ^ ^^^^ P^5«=) f^^'^^^^ °" *he experimental 
evaluation design and the following instruments used: (1) career 
development inventory, (2) self-esteem inventory, (3) 
internal-external scale, (tt) ciP intern interview, (5) CIP parent 
interview, (6) CIP graduate intern questionnaire, and (7) employer 
questionnaire: graduate interns followup. Tabulated raJ daJarthe 
aJJal- Volume I, are presented for the following 

in?r,*hi^Lif 5 ^hj^^teristics when they enter CIP: frequency 
distributions of pretest measures; (2) gains made by interns over the 
fll r. r^'^s; P?ol^^ frequency distribution of pre- and pos?-tesJs 
for cohorts entering January and June 197«»; and (3) differential 
gams made by subgroups of the January and June cohorts over the 
first 10 weeks. Section 2 presents the ethographic design used to 
ttllttl '^^^ comprising -the program descrip?ion and case 

(lu?ho?/E?) • ' contains figures on cost per intern. 
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INTRODUCTION 



This volume, serving as a technical appendix to The Career Intern 
Program: Preliminary Results of an Experiment in Car eer Education. 
Volume I, provides support and corroboration for conclusions 
reached in that primary document. Data presented here were 
collected as part of the evaluation of the Career Intern Program, 
operated by the Opportunities Industrialization Centers of America,, 
Inc. (OICs/A). The evaluation itself is being conducted by 
Richard A. Gibboney Associates, Inc., under a contract from OICs/A. 
The National Institute of Education has provided support for both 
the program and the evaluation activities under contract number 
NE-C'00-3-0122. 

Volume II is intended for those who wish to obtain a clear picture 
of the actual research designs im.plemented or who wish to examine 
summary tables of the data. For those desiring additional informa- 
tion beyond the scope of this report, inquiries should be directed 
to: 

Richard A. Gibboney Associates, Inc. 
8117 Old York Road 
Elkins Park, Pennsylvania 19117 

Section I. A. of this volume presents the experimental research design 
as it was originally conceived and as it was actually implemented, 
and in addition, the concomitant instrumentation used to collect data 
pursuant to these designs. Sections I.B., I.C., and I.D. present 
summaries of the actual data. The reader is cautioned to note the 
brief introductions to each of these sections, as they provide impor- 
tant information for the accurate interpretation of the ensuing tables 
and a cross-reference for the data described in Volume I to the 
tables in Volume II. 

Section II presents the ethnographic design used to collect qualita- 
tive data comprising the program description and case studies in 
Volume I. These data consist largely of interview transcriptions 
and field notes, and both their length and the requirements of con- 
fidentiality preclude their inclusion in this report. 

Section III contains per capita cost figures for the Career Intern 
Program. These data were collected in their entirety by the account- 
ing firm of Price Waterhouse and Company, which is solely responsible 
for their accuracy. Additional inquiries relating to costs should be 
addressed to: 
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Urban Career Education Center 
Opportunities Industrialization Centers of America, Inc. 
100 West Coulter Street 
Philadelphia, Pennsylvania 19144 

The authors of this report wish to express their continuing thanks 
to Dr. Lois-ellin Datta, Chief of Planning, Research, and Evalua- 
tion, National Institute of Education, and Mr. Albert D. Cunningham, 
Jr., Project Officer, National Institute of Education, for their 
timely reviews and comments on the data and interpretation. In 
addition sincere thanks should be extended to Ms. Virginia H. Murphy, 
Office Manager of Richard A. Gibboney Associates. Inc., who made it 
her special responsibility to see both to the accuracy and complete- 
ness ot the data presented here and to their appropriate representa- 
tion in Volume I. Ultimate responsibility for the collection and 
interpretation of data rests, however, with the authors; and the 
opinions expressed herein do not necessarily represent those of the 
National Institute of Education. 
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SECTION A 



TOE EXPERIMENTAL EVALUATION DESIGN 



An evaluation design was included as part of the original proposal 
t^bmUted to the National Institute of Education (NIB) in December 
1973 This design, however, changed to incorporate inputs from 
many sources. NIE personnel and staff members from the Opportuni- 
Ues IndStrialization Centers of America (OICs/A) contributed 
much in clarifying many issues. M implementation began and pro- 
gressed, evaluation and program staff began to- see needed modifi- 
cations in the program, the goals and ""^^""'^'"^^^"^f ' 
evaluation design. Section A is organized into three parts to 
hllptSe reader understand these changes, "me first Presents 
the entire design as it was originally proposed. The second sum- 
iarites the actSal implemented design for the period covered in 
this report Finally, part three presents the instruments devel- 
oped I^d used in con;c?ing the data on which this report xs based. 



1. TOE PROPOSED DESIGN, DECEf^IBER 1973 



INTRODUCTION 

Several basic questions need to be answered in the summative evalua- 
tion of the Career Intern Program. 

1 Do students admitted into the CIP show significantly 
' greater gains in cognitive skills, academic achieve- 
ment, vocational adjustment, future orientation and 
self-image than students denied admission into the 
CIP? 

2 Do students admitted into the CIP show significantly 
greater gains in cognitive skills, academic achieve- 
ment, vocational adjustment, future orientation, and 
self-image t->an a similar group of students attend- 
ing a standard high school program? 

3. DO students admitted into the CIP show greater career 
progress than students denied admission into the CIP? 

4 Do students admitted into the CIP show greater career 
progress than a similar group of students attending 
a standard high school program? 

The evaluation design that follows treats four topics: C J) Descrip- 
tion of summative outcome measures. (2) procedures for establishing 
experimen^^ and comparison groups. (3) description of the evalua- 
tion design for each CIP entry group, and (4) design summary and 
statistical analyses. 



SUMMATIVE OUTCOME MEASURES 

The instrui.>ents discussed below have been chosen on the basis of 
our fSuarity with them from past experience, plus our inspection 
of thf test manuals and reviews of them in books and periodica s. 
We Relieve, however, that it is essential that these instruments be 
Tre- sted'on this particular population, and we pla. to use the 
cohort of interns that entered the program in September 1973 or be 
fore for this purpose. Many a test shown to be very useful in one 
population proves to be inapplicable to another population, and 
this can usually be determined only by actual tryout. 
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Cognitive Development 



ratron^''''K'f -^^ Matrices, Published by the Psychological Corpo- 
ration. This IS a measure of nonverbal reasoning with pictorial 

se ecTwhich'd:^!!; "'"^ °' '''"^ '^^"^'^ the ^xL^^^e to 
series "^J^^.f ^^2" is appropriate to continue a two-dimensional 
series. It is expected that this instrument will tap some co^ni 

Matrices requires 45 minutes for administration. regressive 

Analysis of Learning Pot ential. Advanced T To.,o1 Published hv 
Ffarcourt Brace J ovaKovich. This instrument conta ins subtests in 
volving work-relational concepts, number concepts and fi^Je Con- 
cepts. Since the total testing time is 93 minStes. ?t mfK wis! 
to use only some of the subtests. Subtests will b^ choZn on tlT 
basis of pilot studv rp«;iin-«: Dio., J J • • cnosen on the 

nm^* J J °^ stuay results. Planned administration time is 

Academic Achievem ent 

JepJesenSLe^ Also, minority group 

trarion ot these tests will be in several sessions, reauirin^ 
approximately three hours of testing time. requiring 

Vocational Adjustment 

Career Maturity Inventory ( CMI) . Att itude Srai. Published bv the 
ters related to career choice and orientation toward work Si-anH^r.^ 

ihf sSth'tade^'r' r^^r^ ''^ a^pr'^xiLl:^ 
the sixth-grade level and takes about 30 minutes to administer. 

Career Development Inventory rrnri Written by Super and avail- 
able from him. The CDI yields scores on three scales- tannine 
SSin^'T' Exploration, and Information and Secision- 

Making. Approximately 30 minutes of administration time is req^i^eS 
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A choice will be made between the CMI and the GDI on the basis of 
pilot- test results. 



Future Orientation 



Tntemal-Ex temal Scale . Developed by Rotter and available, fro* 
him. This questionnaire measures the extent to which the examinee 
feels his/her fate in life is determined by his/her own effort, as 
opposed to that by forces in the environment over which the examinee 
has little control. Approximately 20 minutes of administration time 
is required. Extensive research has been conducted on it during the 
past eight years. 

rareer Maturity Inventory. Looking Ahead Subtest . (See above.) On 
iach item the examinee is given an occupational title and three 
steps that a person could complete to prepare for and enter this 
occupation. The examinee is then given four ways in which these 
steps could be ordered and is asked to select the correct order for 
completing the three steps. 

Self- Image 

Self -Estee m Inventor/ . Developed by Coopersmith and available from 
hilii This questionnaire is considered by many to be the best mea- 
sure available of self-image at the primary and secondary school 
levels. Trowbridge has recently done a study on thousands of Iowa 
school children using this instrument, in which she analyzed dif- 
ferences on the items between lower- and middle-class children. 
The items showing large differences in percentages seemed to make 
meaningful patterns. The estimated time to complete the inventory 
is 20 minutes . 

Semant ic Differential . Previous workers on this project developed 
an instrvunent tailor-made for this particular population, using the 
three concepts of Myself. School, and Work. We will shortly analyze 
the data that have been collected. 

r.r^ ^r Progress Criteria . Students will be classified as making 
successful career progress if they have (1) entered college, (2) 
been placed on a job, or (3) entered advanced technical training. 

EXPERIMENTAL AND COMPARISON GROUPS 

The overall proposed design involves an amalgamation of several 
small designs, some of which involve "true experimental" contrasts 
and some of which involve "quasi-experimental" contrasts. The 
treatment effects are thus tested in several different ways. 

li 
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Contrasts are made between experimental groups and three types of 

.roSns^^^d'm^H" '^^"^^^l g-°"Ps. C2) high schSol co^arison 

groups and ^3) declmer groups. A group that participates in the 

?e^te'r p'-f ^" experimental group designated by'he 

xetter 'E." Comparison groups do not participate in the CIP and 
are designated by the letter "C." ^ 

The term "control group" is applied to groups constituted by random 
ar^fssi^LdT ' f applicants! other memLls^/^Mch 

a^e Arllf ^n experimental group. High school comparison groups 
dents f^^ t^rrrS ^"^"ding Germantown High School. Since stL 

no^^nt ^ i ^ recruited by obtaining a list of dropouts and 
potential dropouts from Germantown counselors, this procedure will 
be used to obtain students for the comparison groups^ "Sis ^a! 
the comparison groups will be more similar to Experimental groups 
than a random sample of Germantown students. Decliner groups con- 
sist of applicants who were invited to enroll in the CIP bufw^o did 

The size of the entering experimental group is limited by the total 
program capacity of 150 students. From discussions with the Ci? 
staff estimates of entry group size have been obtained based on 
projected graduation rates. If program dropout occurs, 'experimental 
forng%':ble"' ' '"^'^ reported'in'?hrfo? 



TABLE A.l 



ESTIMATED NUMBER OF INTERNS TO BE ADMITTED 
INTO THE CAREER INTERN PROGRAM 



ENTRY DATE 



NUMBER OF STUDENTS 



January 1974 

May 1974 5q 

September 1974 5q 

January 1975 .r. 

April 1975 5Q 



The number of subjects for the various comparison groups are given 
later m the proposed evaluation design for each entry group. 
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DESIGN FOR DATA GATHERING PROCEDURES 

As described earlier, five categories of outcome measures are to be 
administered to experimental and comparison groups: (1) cognitive 
development, (2) academic achievement, (3) vocational adjustment, 
(4) future orientation, and (5) self-image. 

All the above measures will be administered as pre-tests to entering 
experimental and comparison groups. These initial measures are de- 
signated by the symbol "Oi." They will be re-administered one year 
later as post-tests, indicated by the symbol "O3." 

Phase I of the program consists of a ten-week set of courses intended 
to increase student self -awareness and career-awareness, and to re- 
view academic subjects. Thus, the measures chosen for administra- 
tion at the end of Phase I reflect these attitudinal outcomes: U3 
vocational adjustment, (2) future orientation, and (3) self-image. 
Standardized measures of cognitive development and academic achieve- 
ment are not included as Phase I outcome measures (designated U2 J 
because it is unrealistic to expect significant gains in achievement 
in ten weeks. 

Two problems are anticipated in gathering O2 and 0-^ data. First, 
ir a Black urban population, frequent changes of address may make 
it difficult to locate subjects for post-testing. Second, once 
located, subjects may not want to cooperate in providing post -test 
data. This will be especially true for control group members. 

To help find subjects who cannot be located by usual methods, plans 
are being developed to use collection agencies to determine the sub- 
iects' current address. To encourage subjects to participate m pro- 
viding information, about five dollars for each hour of testing time 
will be paid. 
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Design for January and May -1974 Entry Groups 

■me January 1974 entry group will allow testing of both Phase I and 
Phase II program effects. However, the January 1974 group will be 
entering a program undergoing formative evaluation. Program sta- 
bility cannot be assumed until the May 1974 entry group. Conse- 
quently, the major summative evaluation efforts will be made for 
the May and September 1974 groups. The summative evaluation con- 
ducted with the January 1974 entry group can allow a tryout of eval- 
uation procedures to be applied again with later groups. 

A major problem is anticipated in the cooperation of control groups 
permanently denied admission into the CIP. To minimize negative re- 
actions, several steps will be taken. First, students recruxted for 
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the program will be informed that all who want to enter may not be 
admitted because of program capacity limitations, but that stu- 
dents not admitted can be of help in providing evidence of pro- 
gram effectiveness and will be paid for their assistance. Se- 
cond, the community will be educated to the need for program eval- 
uation. Third the January 1974 control group will be kept small 
' . ^ '''^^^ ^® ^^^^ ^° estimate community reaction, 
locating control group members, and problems in en- 
listing their cooperation.. From this experience, methods will be 
developed to minimize problems in later entry groups. 

implemenier'' '''' '''' ^oUo.ing design will be 



TABLE A. 2 

DESIGN FOR TESTING JANUARY AND MAY 1974 GROUPS 



GROUP 




TESTING 




R* Experimental 
R Control 
Decliner 


Ol 
Ol 
Ol 


(Phase I) 


02 
02 
02 


(Phase II) O3 

O3 
O3 


'^Kandom assignment ' 



Assuming that 90 students will be available from recruitment and in- 
take procedures in January 1974, 60 will be randomly assigned to the 
experimental group and 30 to the control group. A Germantown High 
School comparison group, drawn as described above, will provide an- 
other comparison group for the testing of Phase I and Phase II effects 
Such a group (N = 50) will not have the negative attitudes that might ' 
result from denial of admission to CIP. 

CIP staff estimate that about 30 or more qualified students will 
decline an offer to enter the program. Thus, it can be determined 
whether those students who choose to enter show greater gains in 
skills and attitudes than those who do not. 

The symbols "0i,""02," and "O3" denote the set of observations 
previously described. "Oj" is administered before entry into the 
program. "O2" occurs at the end of the ten-week Phase I period 
O3 IS administered one year later to measure Phase II effects 
All four January 1974 groups will be followed up in September 1975 
iious'lHescriSed' Progress, according to the criteria pre- 

14 



ERIC 



-12- 



For the May 1974 entry group, the Career Intern Program should be 
essentially stabilized. The designs for January and May 1974 are 
intended to be identical, except that the control group in May will 
contain 50 students. Other group sizes will remain the same. 

TABLE A. 3 

DESIGN FOR TESTING SEPTEMBER 1974 GROUPS 



GROUP 




TESTING 






R* Experimental 


Ol 


(Phase I) P2 


(Phase II 


O3 


R Delayed Ex- 
perimental 
Group 


Ol 


O2 


(Phase I, 
Phase II) 


O3 


R Control Group 


Ol 






O3 


Comparison 
Group 


Ol 


O2 




O3 


Decliner 


Ol 


O2 




O3 



♦Random assignment 



Assuming that 160 students can be made available, 50 will be ran- 
domly assigned to Phase I in September 1974, 60 will be randomly 
assigned to delayed entry in January 1975, and 50 will be randomly 
assigned to a control group. 

All Ol measures will be administered in September 1974 before entry 
into the program. O2 will be administered after the experimental 
group has completed Phase I, while O3 will be administered for all 
groups in September 1975. Career progress criteria will be obtained 
at the same time. 

There are several reasons for using a delayed group in this dtsign. 
First since these individuals have the opportunity to enter the pro- 
gram in January 1975, they are more likely to be cooperative in pro- 
viding O2 data than a group denied admission. Second, since students 
are randomly assigned to experimental and delayed groups, O3 compari- 
sons can be made that will indicate differences in gains between ^a 
group in the program for one year versus a group in the program for 
nine months. Third, since Phase I will be evaluated using the delayed 
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group, the problem of repeat testing (0,) is eliminated in the con- 
trol group. ■ ^ 

The implementation of the control group proposed in Table A. 3 will- 
depend upon the January and May 1974 control groups. There is no 
reason to include a control group if experience indicates such a 
procedure engenders community hostility and fails to provide ade- 
quate data for comparisons. If, however, satisfactory procedures 
for obtaining control group data have, been devised as a result of 
the January and May experiences, a control group of 50 subjects will 
be included in the September design. 

As for other groups, a comparison group of 50 students will be drawn 
from Germantown High School. Because of the larger recruitment ef- 
fort required to obtain 16X5 students for September 1974, a decliner 
group of approximately 50 students is anticipated. 

Every effort will be made to encourage all the delayed group to 
enter the program in January 1975. If most do, no additional re- 
cruitment for January will be required. If losses from the de- 
layed group are substantial, however, an additional January entry 
group will be recruited. ^ 

Design for the May 1975 Group 

The May 1975 group can only be used for the evaluation of Phase I 
effects. Two questions will be answered using this group- (l) 
Do students who have completed Phase I of the Career Intern Program 
show higher scores on vocational adjustment, future orientation, and 
self-image measures than a similar group of students tested before 
entry into Phase I? (2) For students who have experienced Phase I 
of the program, do those who have been pre-tested show higher scores 
on vocational adjustment, future orientation, and self-image than 
those who have not? 

The following quasi-experimental design can provide the answer to 
the above questions: 

Group 1 (R) Ol (Phase I) Oo 
Group 2 (R) (Phase I) O2 ' 

Fifty entering students will be randomly divided into two groups 
of 25 each. One group will be pre-tested, the other will not. To 
answer the first question, Oj for Group 1 will be compared to O2 for 
Group 2. To answer the second question, O2 for both Groups 1 and 
2 can be compared. 
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DESIGN SUMMARY AND ANALYSIS 



The proposed design represents an amalgamation of several smaller 
designs, some of which involve true experimental contrasts. The 
CIP treatment effect is thus tested in several different ways. 

The total design is presented symbolically on the design siammary 
chart. Each group of subjects is coded by the letter "E," in- 
dicating an experimental group, or the letter "C," indicating a 
comparison group. Subscripts following the E or C identify a 
particular group. Comparison groups are of three types: (1) true 
control groups consisting of subjects randomly assigned and per- 
manently withheld from the Career Intern Program; (2) Germantown 
High School comparison groups consisting of students similar to 
those recruited to CIP; (3) decliner groups consisting of subjects 
who declined to enter the program when given the opportunity to 
enter . 

A relatively novel feature of this design is the use of a "delayed 
group.'' This group serves first in the role of a control group and 
later in the role of an experimental group. To show the dual role, 
the delayed group is coded C7-E4. 

The time line for the design is indicated by the months and years 
coded across the top of Figure A.l. The symbol ''R" indicates ran- 
dom assignment of subjects to groups. A dotted line separating 
groups indicates non -random assignment. Pj indicates Phase I and 
Pjj stands for Phase II of the program. 

The sym.bols "0^," and ''O3" indicate the administration of a 

particular set of measures. 0^ and O2 measures include tests of 
cognitive development, academic achievement, vocational adjustment, 
future orientation, and self-image. O2 measures for testing Phase I 
effects include vocational adjustment, future orientation, and self- 
image. Specific measures of these outcomes were described previously 

Table A. 4 lists all experimental and comparison groups, their es- 
timated size, date of pre-testing, and a brief description of each 
group . 

To test Phase I effects, experimental and comparison groups will be 
tested for differences on O2 measures. Analysis of covariance using 
the 0^ measures as covariates will provide significance tests of 
group differences. 
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TABLE A. 4 
POPULATIONS TO BE STUDIED 



— DATE OF PRE-TESTING 

DESIGNATION ESTIMATED (OR ENTRANCE INTO DESCRIPTION 





KTf IMDHD 






El 


60 


January 1974 


Experimental Group 




50 


May 1974 


Experimental Group 


^3 


*^fl 
j\j 


September 1974 


Experimental Group 


E4 


fid 


Seotember 1974 


Delayed Group to 




Enter January 1975 


Ec 


25 


May 1975 


Experimental Group 




(Pre- tested) 


Ea 


25 


May 1975 


Experimental Group 




(Not Pre-tested) 


Ci 


30 


January 1974 


Randomly Assigned 


^1 




Control Group 


C2 


50 


January 1974 


Germantown High Com- 






parison Group 


C3 


30 


January 1974 


Dec liner Group 


C4 


50 


May 1974 


Randomly Assigned 




Control Group 


C5 


50 


May 1974 


Germantown High Com- 




parison Group 


C6 


50 


May 1974 


Dec liner Group 


C7 


60 


September 1974 


Delayed Group to 




Enter January 1975 


C8 


50 


September 1974 


Randomly Assigned 




Control Group (Imple 
mented If Feasible) 


C9 


50 


September 1974 


Germantown High Com- 






parison Group 


ClO 


50 


September 1974 


Dec liner Group 
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The following testings will examine Phase I effects: 



(a) Ej vs. Cj, Ej vs. Ej vs. C3; 
Cb) E2 vs. C4, E2 vs. C5, E2 vs. C^; 
(c) E3 vs. C7, E3 vs. Cg, E3 vs. CjQ 



Gains in Phase I will be examined using a t-test of differences • 
between Oj for E5 and 0^ for Eg. The effects of pre-testing on Phase I 
post-tests will be examined by using a t-test of differences between 
O2.for E5 and O2 for E^. 

To test for combined Phase I and Phase II effects, experimental and 
comparison groups will be tested for differences on O3 measures. 
Again, analysis of covariance using Oj measures as covariates will 
provide significance tests of group differences. 

The following testings will examine Phase II effects; 

(a) Ej vs. Cj, Ej vs. Ej vs. C3; 

(b) E2 vs. C4, E2 vs. Cg, E2 vs. C^; 

(c) E3 vs. Cg, E3 vs. C9, E3 vs. Cjo* 



All tests will be made at the .05 level of significance. 

Differences betweeen equivalent groups in the program for different 
periods of time can be tested by comparing E3 versus E. on O3 measures. 
Analysis of covariance will be used with Oj measures as covariates. 

All groups except E^ and E^ will be measured in September 1975 on 
the "career progress criteria." The percentages that have (1) 
entered college, (2) entered advanced technical training, and (3) 
been placed on a job will be determined. Analyses of these data 
will be by chi-square tests of independence. 
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2. THE IMPLEMENTED DESIGN, JANUARY 1974 TO AUGUST 1974 



INTRODUCTION 

Two basic questions are to be answered in the summative evaluation 
design: 

1. Do students admitted into the Career Intern Program 
show significantly greater gains in cognitive skills, 
academic achievement, vocational adjustment, future 
orientation, and self-image than students denied ad- 
mission into the program? 

2. Do students admitted into the CIP show greater career 
progress than students denied admission? 

The evaluation design that follows treats five topics: (1) descrip- 
tion of summative outcome measures, (2) procedures for establishing 
experimental and comparison groups, (3) data gathering procedures, 
(4) description of the evaluation design for each CIP entry group, 
and (5) design summary and statistical analyses. 



SUMMATIVE OUTCOME MEASURES 

Three types of data gathering instruments were used in this study: 
(1) objective standardized instruments available commercially, (2) 
objective instruments available from authors, and (3) objective and 
open-ended instruments developed specifically for this study. In 
this section the sources of the commercially available instruments 
are presented for the interested reader. Samples of the instruments 
available from authors and instruments developed specifically for 
this study are presented in their entirety in section 3 of Appendix 
I. A. 

The summative instruments tentatively sielected in the original pro- 
posal were given field trials between September and November 1973, 
using the interns already in the program as the population. Selec- 
tion of the instruments for use was based on a combination of inputs-- 
intem questions and comments, observations of intern behavior during 
testing, program staff comments, test administration considerations , - 
and score distributions. Short descriptions of the instruments 
selected are presented below. 
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Commercially Available Instruments 



Cognitive Skills: Standard Progressive Matrices (SPM) , by J. C. 
Raven. Published by H. K. Lewis and Company, Ltd., London. Distrib- 
uted in the United States by The Psychological Corporation, 304 East 
45th Street, New York, New York 10017. 

The SPM measures non-verbal reasoning using pictorial designs as 
stimuli. It taps, aspects of cognitive development that are not the 
principle focus of measurements made with instruments containing 
primarily verbal and mathematical stimuli. The SPM has been used 
in numerous studies involving cross-cultural comparisons and com- 
parisons using multiple instruments. These studies establish the 
usefulness of the instrument and its applicability to minority cul- 
tures. In the review of the SPM in CSE Secondary School Test Evalua- 
tion this instrument was given the maximum rating for theoretical 
construct validity. The major criticism of the SPM is that it is 
not well standardized and was not standardized in this country. In 
light of the studies that have been done in this country using the 
instrument, however, ample normative data are available from sources 
other than the developer. Previous experience with applicants to 
CIP has shown that this instrument is well received by the popula- 
tion, possibly because it does not look so much like a test as a 
series of puzzles. Analysis of previously collected data show that 
this instrument correlates with academic achievement. It may have 
an added usefulness as an adjunct to diagnostic testing and/or to 
predicting differential effects of the program. The SPM is admin- 
istered untimed so that it is unaffected by interruptions. The 
typical working time is 30-45 minutes. 

Academic Achievement: Stanford Achievement Tests CSAT) , Advanced 
Battery , by Richard Madden et al. Published by Harcourt Brace 
Jovanovich, Inc., 757 Third Avenue, New York, New York 10017. 

The SAT Reading Comprehension and Mathematics Applications scales 
are used to measure academic achievement. These two scales are of 
sufficient length to be very reliable, .94 and .91 respectively. 
The developers have taken careful steps to assure that the norming 
group included a proportional representation of minority persons 
throughout the country. It is administered under timed conditions, 
which works against some applicants if the time demanded exceeds 
their concentration span. The instrument is long and very academic 
looking, which combine to elicit some resistance from program appli- 
cants . However, previous experience has shown that the SAT is 
nevertheless accepted by the applicants as a worthwhile task and 
that they work carefully to complete it. It is appropriate for the 
range of abilities in this population. The reading test results 
are also used as the admission criterion (grade equivalent equal 
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to 5.0 minus one standard error); and the instrument is used to 
identify interns who need remedial instruction in reading and mathe- 
matics'^ The overall administration time for the SAT is 45 minutes, 
with 35 minutes devoted to the test itself. 



Objective Instruments Available From the Authors 

The three instruments in this category are all reviewed in A Source- 
book for Mental Health Measures, by Andrew L. Comrey, Thomas E. 
Backer, and Edward M. Glaser, published by the Human Interaction 
Research Institute, 10889 Wilshire Boulevard, Los Angeles, California 
90024. The descriptions from that document are presented below, 
along with comments about its use in the present study. 

Vocational Adjustment: Career Development Inventory (CDI), Form I , 
by Donald E. Super, Teachers College, Columbia University, New York, 
New York 10027. 1972. 

••The Career Development Inventory (CDI) is an objective, 
multifactor, self-administering, paper and pencil inven- 
tory measuring the vocational maturity of adolescent 
boys and girls. This instrument yields three scores. 
Two of them are attitudinal and one of them is cognitive, 
plus a total score. The scales are: 1) Planning Orien- 
tation (33 items); 2) Resources for Exploration (28 
items); and 3) Information and Decision-Making (30 items). 
These three scales were obtained from the factor analysis 
of 13 original scales. The questions were written so 
they would be appropriate for both boys and girls. The 
degree of reading difficulty of the CDI makes its usage 
appropriate at and above the sixth grade level. Its 
vocabulary and content make it acceptable to junior and 
senior high school students in any grade. For the average 
student, the CDI takes no more than a half- hour to com- 
plete. All students should easily complete the CDI within 
50 minutes. The CDI does not measure aptitude, school 
achievement, or occupational skill and competence. The 
CDI seeks to assess career or vocational development. It 
may be used for both group and individual counseling or 
for evaluating career or vocational development. The 
test-retest reliabilities for each of the three tests are 
.85, .82, and .71; for the total the reliability coeffi- 
cient is reported to be .87. Research by the authors 
suggests some validity for all three scales. A copy of 
the instrument, preliminary manual, and additional, informa- 
tion are available from the first author.'* 
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This instrument is administered without time limits; so nothing is 
lost if subjects take a break while completing it. Experience with 
this instrument has shown that in its current form it is confusing 
to complete because of question format and page layout. Secondly 
the scoring procedure does not yield as much usable data as possible. 
Changes in item and page format can make this instrument much easier 
tor the respondent without changing the content or any of the items 
Minor revisions in the scoring will increase the yield from the in-' 
strument. A further, more serious weakness of the instrument is 
the inappropriateness of the items on the Information and Decision- 
Making scale. The GDI currently requires 30 minutes to an hour 
for most applicants to complete. 



Self-image: Self-Estee m Inventory fS-EII . by Stanley Coopersmith, 
Psychology Department, University of California, Davis, California 
95616. 1968. 

"The Self-Esteem Inventory is an instrument designed to 
assess general level of self-esteem. The instrument 
has been used on both male and female subjects ranging 
in age from nine to adult level. There are two forms 
of the self-esteem inventory. Form A contains 48 items 
and a total of five subscales; Form B contains 25 items 
and no subscales. The two forms correlate .86. Form A 
contains items comprising five subscales which cycle in 
sequence the length of the instrument. These scales 
are "General self," "Social self-peers," "Home-parents," 
"School-academic," and a lie scale. A sample item is- 
"I'm a lot of fun to be with." The respondent is asked 
to check one of two columns ("like me," or, "unlike me") 
which best describes how he usually feels. The instru- 
ment is scored by taking the total number correct (i.e., 
indicating high self-esteem) on all scales excluding the 
lie scale, and multiplying by two to obtain a total 
maximum possible of 100. The lie scale is scored sepa- 
rately (maximum of 8) and indicates defens'iveness . 
Form B includes those 25 items from Form A which showed 
the highest item total score relationships of scores on 
Form A obtained from an item analysis. The short form 
IS scored simply by totaling correct responses (maximum 
= 25). The instrument is self-administering. Norms 
are reported for preadolescents (ages 9 to 15) as 70 1 
for females and 72.2 for males. For young adults (16 
to 23) the norm is reported as 76.0. The distribution 
in most samples is skewed in the direction of high self- 
esteem. Validity data and further discussion of the 
application of the instrument to research are available 

u 
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in the author's monograph, The antecedents of self- 
esteem. Freeman: San Francisco, 1968. A copy of the 
instrument and a 15-page bibliography of self-esteem 
studies are available from the author/' 

Experience with this instrument indicates this population responds 
well with no overt resistance or voiced objections. The S-EI is 
administered untimed; so it is not affected by interruptions. The 
typical time for most applicants to complete the instrument is 10 
to 20 minutes. 



Perceived Ability to Influence Future Events: Internal-External 
Scale (I-ES) , by Julian B. Rotter, Department of Psychology, Univer- 
sity of Connecticut, Storrs, Connecticut 06268. 1966. (See Julian 
B. Rotter, ''Generalized Expectancies for Internal Versus External 
Control of Reinforcement," Psychological Monographs 80, No. 609, 
1966.) 

"The Internal- External (I-E) Scale is designed to deter- 
mine the degree to which the respondent expects that 
reward reinforcement is dependent or independent of his 
own behavior. This is accomplished by examining whether 
the individual believes control over reinforcement to 
be internally or externally located. The scale consists 
of 29 forced choice items, each item presenting two con- 
flicting statements from which the subject can choose. 
Some sample items are: "In the long run people get the 
respect they deserve in this world" versus "Unfortunately, 
an individual's worth often passes unrecognized no mat- 
ter how hard he tried"; "No matter how hard you try some 
people just don't like you" versus "People who can't get 
others to like them don't understand how to get along 
with others"; "The average citizen can have an influence 
in government decisions" versus "This world is run by 
the few people in power, and there is not much the little 
guy can do about it." The scale is scored by counting 
the total number of external choices selected. A high 
scQie indicates an expectancy of external control, and 
a low score an expectancy of internal control. Relevant 
material concerning the scale's validity and reliability 
may be found in the source document, Tolor, A., and 
Jalowiec, J. E., Body, boundary, parental attitudes, 
and internal -external expectancy. Journal of Consulting 
and Clinical Psychology , 1968, 32, 206-209, found a rela- 
tionship between parental authoritarian control and re- 
jection factors and external expectancy. The scale was 
also used in Tolor, A., Brannigan, G. G., and Murphy, V. M. , 
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Psychological distance, future time perspective, and 
internal -external expectancy. Journal of Projective 
Techniques and Personality Assessment , 1970, 34, 283- 
294, A copy of the instrument is available from 
Dr, Alexander Tolor, Director, Institute for Human 
Development, Fairfield University, Fairfield, CT 
06430." 

As interns learn more about careers, career selection, and means of 
career entry, they should develop greater belief in their ability 
to influence future events, i.e., gain entry into a career of their 
choice. Experience with the I-ES has shown that the population 
served by the CIP is willing to respond to this type of instrument 
and to this instrument specifically, but that some of the items, 
especially the non-scored ones, cause frustration and resistance. 
These should be reworded to reduce ambiguity and increase respon- 
siveness and cooperation. 

In using this instrument in our population and in reviewing the 
literature more carefully, it has become increasingly clear that 
the construct of intemality-extemality is not as simple as had 
been hoped. It is unclear if this instrument measures an invariant 
personality characteristic of the respondent or an attitudinal 
variable that is amenable to change. This instrument is untimed 
so that breaks or interruptions will not interfere with the data 
gathering. The administration time is about 15 to 25 minutes. 

Copies of the Career Development Inventory, the Self-Esteem Inven- 
tory, and the Internal-External Scale may be found in section 3 of 
Appendix I. A., as Exhibits 1, 2, and 3. 

Instruments Developed for This Study 

Five data collection instruments were developed for use with this 
study. The first was the CIP Intern Interview form, to be completed 
for all applicants at the time of their initial interview for admis- 
sion to the program. Before admission, a parent or guardian of 
each minor applicant was asked to come in for an interview, to be 
recorded on the CIP Parent Interview form. These two instruments 
appear as Exhibits 4 and 5 in section 3 of Appendix I. A. The infor- 
mation about what former interns were doing, as well as information 
about the plans of interns graduating from CIP in August 1974, was 
gathered using two variations of basically the same instrument. 
These appear as Exhibits 6 and 7. Employer reactions to employees 
who were CIP graduates were gathered from the Employer Questionnaire- 
Graduate Interns - Follow-up. This appears as Exhibit 8. 
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Factual Data Used as Career Progress Criteria 



The instruments discussed above all are designed to answer the sev- 
eral components of the first major question addressed by tho evalua- 
tion design. The second major question--whether CIP interns make 
greater career progress than applicants not admitted to the program- 
is answered by comparing the success rates of the two groups on the 
following criteria: Students will be classified as making success- 
ful career progress if they have (1) entered college, '2) been 
placed on a job, or (3) entered advanced technical training, 



EXPERIMENTAL AND COMPARISON GROUPS 

The overall proposed design involved an amalgamation of several 
small designs, some of whi-h involved true experimental contrasts 
with rmdomly assigned control groups and some of which involved 
quasi- experimental contrasts with equivalent groups. Actual con- 
trasts, however, were limited to those between randomly assigned 
experimental and control groups. The high school comparison group 
was not identified in time for use with this design because of 
administrative considerations. The decliner group was eliminated 
from the design when only three individuals in the experimental 
group declined admission. 

In subsequent sections of this discussion, experimental groups will 
be designated by the letter ''E'' and comparison groups by the letter 
*'C." The letters are subscripted to indicate the date of intake 
of' the particular cohort. Thus, the first cohort, entering the pro- 
gram in January 1974, is designated Ei, The randomly assigned con- 
trol group associated with the first cohort is designated Ci. The 
second cohort entered the program in June 1974 and is designated 
E2 and C2. All interns in the program prior to the initiation of 
the research design are designated as Eq. 



DATA GATHERING PROCEDURES 

As described above, five categories of outcome measures were to be 
administered to experimental and comparison groups: (1) cognitive 
development, (2) academic achievement, (3) vocational adjustment, 
(4) future orientation, and (5) self-image. All these measures 
were administered as pre-tests to entering experimental and compari- 
son groups. The initial measures, designated by the symbol "Oi," 
will be readministered one year later as post-tests, indicated by 
the symbol 

Phase I of the program consists of a ten-week set of courses intended 

i 
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to increase student self -awareness and career- awareness and to re- 
view academic subjects. Thus, the measures chosen for administra- 
tion at the end of Phase I reflect these attitudinal outcomes: 
(1) vocational adjustment, (2) future orientation, and C3) self-image. 
Standardized measures of cognitive development and academic achieve- 
ment were not included as Phase I outcome measures because it is 
unrealistic to expect significant gains in achievement in a ten- week 
time period. The Phase I outcome measures are designated by the 
symbol "O2." 

In order to increase the probability of a response from members of 
the control group to the request for cooperation in the collection 
of O2 and O3 data, they were paid five dollars for completing all 
instruments, in addition to a bus fare and lunch allowance if they 
came to the Urban Career Education Center for testing. If they did 
not come in for testing but were willing to cooperate, the instru- 
ments were mailed to them, and they were paid five dollars when 
they returned the instrxunents properly completed. 

DESIGN FOR JANUARY AND MAY 1974 COHORTS 

The design for the January and May 1974 cohorts is shown in graphic 
form below: * ^ 

experimental Group Oj Phase I O2 Phase II O3 



Control Group Ol 0 



2 O3 



The experimental and control groups were administered the O1 measures 
as part of the intake procedure. All applicants who passed the mini- 
mum reading ability criterion score of fifth grade and completed all 
the instruments were placed in an eligibility pool. Through a random 
seleccion technique, two groups were identif ied-an experimental group 
of 97 and a control group of 30. ^ f 

As mentioned earlier, the symbols "Oi," "O2," and "O3" designate the 
three points of observation. Oj was administered before entry into 
the program. O2 followed ten weeks later at the end of Phase I. Ot 
IS to be administered one year later to measure Phase II effects 
Both January 1974 entry groups, experimental and control, will be 
followed up in July 1975 to determine their career progress, accord- 
ing to the criteria previously described. 

While the May 1974 entry group followed the same design as the Janu- 
ary cohort, there was one slight variation, in that the ten-week 
Phase I segment of the program spanned the summer vacation. Career 
progress data will be collected from the E2 and C2 groups in November 
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1975. The intake procedure resulted in the availability of 76 eli- 
gible applicants. These were randomly assigned to two groups, 38 
in the experimental group and 38 in the control. 

Table A. 5 lists all experimental and comparison groups, their size, 
date of pre-testing, and a brief description of each group. 



TABLE A. 5 
JANUARY AND MAY 1974 COHORTS 



DESIGNATION 


NUMBER 


DATE OF PRE-TESTING 

(or entrance into 
program:) 


DESCRIPTION 


El 
E2 
Cl 

C2 


97 
29 
38 
38 


January 1974 
May 1974 
January 1974 
May 1974 


Experimental 
Experimental 
Control 
Control 



DESIGN SUMMARY AND ANALYSIS 

The design as it was implemented is presented symbolically on the 
design summary chart (Figure A.2). Oi and O3 measures include tests 
of cognitive development, academic achievement, vocational adjust- 
ment, future orientation, and self-image. O2 measures for testing 
Phase I effects include vocational adjustment, future orientation, 
and self-image. Specific measures of these outcomes were described 
previously. 

Individual comparison to test the Phase I effects were all made using 
correlated t-tests. Before proceeding with these tests the experi- 
mental and control groups were compared for differences between the 
mean and for homogeneity of variance. In addition, the January and 
May cohorts were similarly compared. In all three comparisons, no 
significant differences were found. Because of numerous data collec- 
tion problems in the early days of the study, the data from the 
January and May cohorts were pooled to provide a justifiable sample 
size. The comparisons were made between the Oi and O2 measures for 
the total pooled group and for several subsets of the group. Sepa- 
rate analyses were performed for females and males, high and low 
readers, and dropouts and non-dropouts. 
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3. INSTRUMENTS OF THE EXPERIMENTAL DESIGN 



This section includes as exhibits copies of instruments used in the 
Sjerimenia^ design which are available from the authors and those 
which were developed particularly for the present study. They are. 

EXHIBIT 1: Career Development Inventory 

EXHIBIT 2: Self-Esteem Inventory 



EXHIBIT 3: 



Internal-External Scale 



EXHIBIT 4: CIP Intern Interview 

EXHIBIT 5: CIP Parent Interview 57 



EXHIBIT 6: CIP Graduate Intern Questionnaire. 



69 



EXHIBIT 7: Employer Questionnaire: Graduate Interns - 
Follow-up 



For brief discussions of the above 
comnercially available instruments 
Standard Progressive Matrices and 
see Appendix I. A. 2. 



instruments, as well as of two 
also used in the study (Raven's 
the Stanford Achievement Test), 



31 



-29- 



EXHIBIT 1 
CAREER DEVELOPMENT INVENTORY 
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CAREER DEVELOPMENT INVENTORY 



FORM I 

DONALD E. SUPER, ET AL. 

TEACHERS COLLEGE, COLUMBIA UNIVERSITY 
NEW YORK, NEW YORK 

COPYRIGHT 1971 

****************************** 
INTRODUCTION 

The questions you are about to read ask you about school , work your 
future career, and some of the plans you may have made. The only 
right answers are the ones which are right for you. Later, some 
questions ask about career facts; others ask you to judge students 
plans. Give the best answers you can. 

Answers to questions like these can help teachers and counselors 
offer the kind of help which high school students want and need in 
planning and preparing for a job after graduat ion f or vocational 
and technical school training, or for going to college. 

ANSWER ALL QUESTIONS. If you are not sure about an answer, guess. 
There is no time limit, but work as rapidly as you can; the first 
answer that comes to you is often the best one. 



NAME . GRADE DATE 

YOUR FUTURE OCCUPATION 

In your present thoughts and plans, what kind of work would you like 
to do when you finish all of your education and training? What kind 
of occupation do you plan to enter? For example, bookkeeper, 
machinist, lawyer, registered nurse, small store owner, waitress 
engineer, shop foreman, elementary teacher, truck driver, etc. Write 
the name(s) of the occupation(s) you have thought about on the lines 
below. 



If you have given more than one occupation, put an "X" in front of 
your first choice , the one you prefer more than the other. 

33 
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«p'of':ac'S's«tio'„'"""°"^ " instruction, at the 

areas'^Uaj^H^H^;" f^''"".'"^ """^ " following 

areas. What kind of plans do you have? For each Question 

below Choose one of the following answers to :h:I; Zl yZ have 

1) I have not given any thought to this 

2) I have given some thought to this, but haven't made 



5. 



9. 

'10 



14 



any plans yet. 

3) I have some plans, but am still not sure of them. 

4) I have made definite plans, but don't know how to 
carry them out. 

have made definite plans, and know what to do 
to carry them out. 



4) 

5) 



1. Finding out about educational and occupational possibilities 

talkiiS'tn'" 'T' ^^"^^'"2 information ^r 

9 T.^l \ somebody who knows about the possibilities 

tl^nl n decisions with an adult who kno^s some- 

rning about me. 

'^\1"woJk^Jo'a!;°°\'°"^''%^^^"^ will help me decide what line 
d t I u I ^ ^ l^^v® school or college. 

4. ■ Taking high school courses which will help me in college, in 
job training, or on the job. b . ' 

Taking part in school or out-of-school activities which will 

help me m college, in training, or on the job. 
Taking part in school or after-school activities (for example 
science club, school newspaper, Sunday School teaching ' 

of worrto"^r''.' "'t"^ t''*^' ^"^P ^^^'^^ wha?'kind 

ot work to go into when I leave school. 

wS\inrnf"'''"v 7 'T"^ "^^^^ "^^^ h^lP decide 
What kind of work I might go into. 

niS^oJ PT-^i'"« °^ s""™er job which will help me get the 
kind of job or training I want. . P « get tne 

Getting money for college or training, 
Deal 1 no ur-i t-h •hU-;^/*^ ..u--i_ _ . , . . 



Dealing with things which might make it hard for me to get 
the kind of training or the kind of work I would like 
.11. Getting the kind of training, education, or experience which 
I will need to get into the kind of work I want 

-U. JMn°r:J'!!J^"!!^!^ -d training 



'°wh"? iTesl'Tlirt r'V^' i'' ^° ^= a^aluer:m;Llee 

■laid'off-wLn'^Sm:: a^^trt °' ^ ^'^"^ 

''^oiJ'llhoIsi'""'' P--^--. etc.) in the kind of 
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II High school students differ greatly in the amount of time and 
thought they give to making choices . Use the statements below 
to compare yourself to the typical students of your sex m your 
grade on each of the following kinds of choices. 

Compared to my classmates I am. . . . 

1) much below average, not as good as most 

2) a little below average 

3) average 

4) a little above average 

5) much above average, better than most 
in the amount of time and thought I give to: 

15. Choosing high school courses. 

16. Choosing high school activities. 

17. Choosing out-of-school activities. 

18 Choosing between college, junior college, business school, 

■ technical school, work, military service, marriage, 

homemaking, etc. .. 
19. Choosing a college, branch of military service, wife or 

husband, etc. ' , . n ^ 
^20. Choosing, an occupation for after high school, college, or 

job training. 

21. Choosing a career in general. 

22. How would you rate your plans for "after high school"? 

1) Not at all clear or sure. 

2) Not very clear. 

3) Some not clear, some clear. 

4) Fairly clear. 

5) Very clear, all decided. 

III. Below are five possible answers to use in answering questions 

23 through 33, questions about how much you know about the occu- 
pation you said you like best on page one. Mark the number of 
your choice on the answer sheet. 

I know .... 

1) hardly anything 

2) a little 

3) an average amount 

4) a good deal 

5) a great deal 
.... about : 

23. What people really do on the job. 

24. Specialities in the occupation. 

~25. Different places where people might work in this occupation. 
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■ll' '^l nJ'^'^'f ^"f.^^^i^s "eeded in the occupation. 
27. The physical working conditions. 

The education or training needed to get into the occupation 
:ccup"a"L°''^^^' '''' ^estTrT,e 



28. 

"29 



?L"®®'^ people, in the occupation. 

Different ways of entering the occupation. 



^33 

IV. 



The starting pay in the occupation. 
The chances for getting ahead in the occupation. 



ull fir "^^'^ ''^ "^^'^ questions 34 through 

tie sour.^^ ^"r" '° whether or not vou wnniH to ^ 

Job ^^c^riegf ;?fnr"°" ^--^-d belowfor help iTi^ your 

I would. . . . 

1) definitely not 

2) probably not 

3) not be sure whether to 

4) probably 

5) definitely 
go to: 

^54. Father or male guardian, 

. 35. Mother or female guardian. 

^36. Brothers, sisters, or other relatives 

, ^37. Friends. 

^38. Coaches of teams I have been on. 

^39. Minister, priest, or rabbi. 

40. Teachers. 

^41. School counselors. 

^42. Private counselors, outside of school 

^43. Books with the information I needed 

— ""'coXu^ers"'"' '''' '''' recordings, movies, or 
45. College catalogues. 

IV w"""?"" occupation or at the college I am considering 

^47. TV shows, movies, or magazines. considering. 

TnTitlti'' ^rl^^""^ which are to be used with the follow- 

ing Items Th.is time use the statements to show which of tht 

S^^'b^^fu? t^'°" '''' n^'^'^ J^^Mr^on 
wnich has been helpful to you in making your job or college plans 

I have gotten 

1) no useful information 

2) very little useful information 

3) some useful information 

3 6 
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4) a good deal_ of useful information, 

5) a great deal of useful information- 
,,,,from: 

48. Father or male guardian. 

49. Mother or female guardian. 

50. Brothers, sisters, or other relatives. 

51. Friends. 

52. Coaches of teams I have been on. 

53. Minister, priest, or rabbi. 

54 . Teachers • 

55. School counselors. 

56. Private counselors, outside of school. 

■"57. Books with the information I needed. . 

J8. Audio or visual aids like tape recordings, movies, or 
computers. 

-fo: P°e"ofs ini:'^"upatio„ or at the college I a. considering. 

"61. TV shows, movies, or magazines. 

Here, each question has its own set of possible answers. 

62. Which one of the following is the best source of information 
about job duties and opportunities? 

1) The Encyclopedia Britannica 

2) World Almanac 

3) Scholastic Magazine 

4) The Occupational Index 

5) The Occupational Outlook Handbook 



63 Which one of the following would be most useful for detailed 
information about getting into college? 

1) The World Book Encyclopedia 
2) Webster's Collegiate Dictionary 

3) Lovejoy's College Guide 

4) Reader's Digest 

5) The Education Index 

64, Which one of the following pairs of occupations involves the 
same level of training and responsibility? 

. 1) Tailor, Sales Clerk 

2) Engineer, Banker 

3) Tailor, Engineer 

■ 4) Banker, Sales Clerk 

3/ 
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1) Professional and service. 

^ 2) Sales and crafts. 

3) Crafts and clerical. 

4) Labor and sales. 



66. 



VII. 



Between 1910 and 1970, the industry employing the greatest 
number of workers changed from: ^ "g greatest 

\l Agriculture to wholesale and retail trade 

Manufacturing to agriculture 

11 Wholesale and retail trade to manufacturing. 

4 J Agriculture to manufacturing. 

Occupations are different in the amount of education required 
for employment. Match the occupation in Column A wJt^t he amount 
?he1orr:ct"ans::J!^ ^^^"'^^^ -^^^"^ th'e^'^mbTof 



COLUMN A 
Occupation 

__67. Stenographer 

_68. Dental Technician 

^69. Family Doctor (Physician) 

_70. Mail Carrier 

,.71. Plumber 

J2. Computer Operator 

73. Bank Clerk 

74. Social Worker 



1) 

2) 
3) 

4) 
5) 



COLUMN B 
Education 

High School Graduation 
Apprenticeship Training 
Technical School or Community 

College (2-year) 
College Degree (4 -year) 
Professional Degree Beyond 

College 



VIII. 



Many occupations use special tools. Below is a list of special 
tools or equipment and a list of occuDation<; m.^^^ special 
patlon 1„ COW A with its a,u1p::^?''tco?™ b" 



_75. 
J6. 

71. 

78. 
'''79. 



COLUMN A 
Occupation 

Electrician 
Bookkeeper 
Bricklayer 
Dressmaker 
Medical Technician 



COLUMN B 
Equipment 



1) Manikin 

2) Ammeter 

3) Centrifuge 

4) Trowel 

5) Ledger 
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IX. Here again, each question has its own set of answers. 

80. In the 9th and 10th grades, plans about jobs and occupations 
should; 

1) be clear. 

2) not rule out any possibilities. 

3) keep open the best possibilities. 
4) not be something to think about . 

81. Decisions about high school courses can have an effect on: 

1) the kind of diploma one gets. 

2) the kind of training or education one can get after 

high school . 

3) later occupational choices. 

4) how much one likes school. 
~ 5), all of these. 

82. Decisions about jobs should take into account: 

1) strengths, or what one is good at learning and doing. 

2) what one likes to do. 

3) the kind of person one is. , • , ^ a^u 
4) the chances for getting ahead in that kind of job. 

5) all of these. 

83 One of the things that great artists, musicians, and pro- 
fessional athletes have in common is the desire to. 

1) make money. 

2) have large audiences. < 

3) be the best there is at what they do. 

4) teach others to do what they do. 

84 Mary thinks she might like to become a computer programmer, 
but she knows little about computer programming. She is 
going to the library to find out more about it. The most 
important thing for Mary to know now is: 

1) what the work is, what she would do in it. 
~ 2) what the pay is. 
3) what the hours of work are. 
4) where she can get the right training. 
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85. Jane likes her high school biology and general science 
courses best. She likes to do her school work aJone so 
she can concentrate. When she begins to think about her 
future occupation, she. should consider: 



1) nurse. 

2) accountant. 

3) medical laboratory technician. 

elementary school teacher. 



86. 



Peter is the best speaker on the school debating team The 
schoo yearbook describes him as "our golden-tongJer;raIor 
seirlf"" '"^ listen as well as talk-.rcould 

^raiJt5"^'T°K' '° Eskimos." Peter will probably 

fcoref sh^w thlt 2^°" f ^^^^^g^ ^is test 

scores show that he is very bright. His only good grades 

(mostly B's) are in business subjects. His poorest grades 

are in English and social studies (mostly C's° 

Peter's desire to become a trial la-yer is not very 
realistic because: 

_ 1) 



2) 
3) 
4) 



with his grades he will have difficulty getting into 

a four-year liberal arts college, 
he has poor grades in the subjects that are most 
important for law. 

there is much more to being a lawyer than being good 

at public speaking. • * ^ 

all of the above are good reasons for thinking that 
Peter will have a hard time becoming a trial lawyer. 

becoming: ^"'""^ ^^""^'^ ^^ink about 

1) an accountant . 

2) a salesman. 

3) an actor. 

4) a school counselor. 

. 5) a lawyer. 

88. Ernie took some tests which show that he might be good at 

clerical work. Ernie says, "I just can't see mysefHitting 

behind a desk for the rest of my life. I'm the kind of 
:;it^mr?inT.-"H^e ^""^ ^ salesman wo% 

II disregard the tests and do what he wants to do 

23 do what the tests^ say since theyTnow better than he 
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does what he would be good at. 

3) look for a job which will let him use his clerical 

abilities but not keep him pinned to a desk. 

4) ask to be tested with another test since the results 

of the first one are probably wrong. 

89. Joe is very good with his hands and there isn't anybody in 
his class who has more mechanical aptitude. He is ^l^o 
good at art. His best subject at school is math. Joe likes 
all of these things. 

What should Joe do? Should he: 

1) look for an occupation in which he can use as many of 

his interests and abilities as possible? 

2) pick an occupation which uses math since there is a 

better future in that than in art or in working 
with his hands? 

3) decide which of these activities he is best at, or 
likes the most, and th^n pick an occupation which 

uses that kind of activity? 

4) put off deciding about his future and wait until he 

loses interest in some of these activities. 

90. Betty gets very good science grades but this isn't her 

favorite subject. The subject she likes best is art ev?n 
though her grades in it are only average. Betty is most 
likely to do well in her future occupation i£ she: 

1) forgets about her interest in art since she is so much 

better in science. 

2) doesn't worry about the fact that she isn't very good 
at art, because if you like something you can become 

good at it. 

3) looks for an occupation which uses both art and science, 

but more science than art. 

4) looks for an occupation which involves both science 

and art, but more art than science. 

91. Bob says he really doesn't care what kind of work he gets 
into once he leaves school as long as it is working with . 
people. If this is all Bob cares about he is likely to make 
a bad choice because: 

1) this kind of work usually requires a college degree. 

2) employers usually hire girls for such work. 

3) people look down on men who work with people because 

such work is usually done by girls. 
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4) occupations in which one works with people can be 
very different from each other in the abilities 
and interests which are needed. 
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SELF-ESTEEM INVENTORY 

NAME ^ DATE 

DIRECTIONS ; 

Please mark each statement in the following way: 

If the statement describes how you usually feel, put a check (X) in 
the column "Like Me." 

If the statement does not describe how you usually feel, put a check 
(X) in the column "Unlike Me." 

There are no right or wrong answers. 



Like Me Unlike Me 

1. I spend a lot of time daydreaming. 

2. I'm pretty sure of myself. 

3. I often wish I were someone else. 

4. I'm easy to like, 

5. My parents and I have a lot of fun 

together. 

6. I never worry about anything. 

7. I find it very hard to talk in 

front of the class. 

8. I wish I were younger. 

9. There are a lot of things about myself 

I'd change if I could. 

10. I can make up my mind without too 

much trouble. 

11. I'm a lot of fun to be with. 

12. I get upset easily at home. 

13. I always do the right thing. 

14. I'm proud of my school work 

15. Someone always has to tell me what to do. 

16. It takes me a long time to get used to 

anything new. 

17. I'm often sorry for the things I do. 

18. I'm popular with kids my own age. 

19. My parents usually consider my feelings. 

20. I'm never unhappy. 

21. I'm doing the best work that I can. 

22. I give in very easily. 

23. I can usually take care of myself. 

24. I'm pretty happy. 

-45- 




Like Me Unlike Me 

25. I would rather play with children 

younger than me. 

26. My parents expect too much of me. 

27. I like everyone I know. 

28. I like to be called on in class. 

29. I understand myself. 

30. It's pretty tough to be me. 

31. Things are all mixed up in my life. 

32. Kids usually follow my ideas. 

33. No one pays much attention to me at home. 

34. I never get scolded. 

35. I'm not doing as well in school as I'd 

like to. 

36. I can make up my mind and stick to it. 

37. I really don't like being a boy (girl). 

38. I have a low opinion of myself. 

39. I don't like to be with other people. 

40. There are many times when I'd like to " 

leave home. 

41. I'm never shy. 

42. I often feel upset in school. 

43. I often feel ashamed of myself. 

44. I'm not as nice looking as most people. 

45. If I have something to say, I usually 

say it. 

46. Kids pick on me very often. 

47. My parents understand me. 

48. I always tell the truth. 

49. My teacher makes me feel I'm not good 

enough . 

50. I don't care what happens to me. 

51. I'm a failure. 

52. I get upset easily when I'm scolded. 

53. Most people are better liked than I am. 

54. I usually feel as if my parents are 

pushing me. 

55. I always know what to say to people. 

56. I often get discouraged in school. 

57. Things usually don't bother me. 

58. I can't be depended on. 
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INTERNAL- EXTERNAL SCALE 
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NAME 



INTERNAL-EXTERNAL SCALE 

DATE 



DIRECTIONS : 

The purpose of this short task is to determine how you feel about 
certain things. 

Read each of the following paired statements. Which of the two 
statements do you agree with more? Circle that letter . Choose only 
one. (However, be sure to choose one of the paired statements for 
each item) . 

Example: l.a. Most children should be punished by their mothers, 
b. A child knows when' he does something wrong. 



1. a. Children get into trouble because their parents punish them 

too much. 

b. The trouble with most children nowadays is that their parents 
are too easy with them. 

2. a. Many of the unhappy things in people's lives are partly due to 

bad luck. 

b. People's misfortunes result from the mistakes they make. 

3. a. One of the major reasons why we have wars is because people 

don't take enough interest in politics, 
b. There will always be wars, no matter how hard people try to 
prevent them. 

4. a. In the long run people get the respect they deserve in this 

world. 

b. - Unfortunately, an individual's worth often passes unrecognized 
no matter how hard he tries. 

5. a. The idea that teachers are unfair to students is nonsense, 
b. Most students don't realize the extent to which their grades 

are influenced by accidental happenings. 

6. a. Without the right breaks one cannot be an effective leader, 
b. Capable people who fail to become leaders have not taken 

advantage of their opportunities. 

7. a. No matter how hard you try some people just don't like you. 
b. People who can't get others to like them don't understand how 

to get along with others. 

4V 
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8. a. Heredity plays the major role in determining one's personality, 
b. It is one's experiences in life which determine what they're 

like. ^ 

9. a. I have often found that what is going to happen will happen, 
b. Trusting to fate has never turned out as well for me as making 

a decision to take a definite course of action. 

10. a. In the case of the well prepared student there is rarely if 

ever such a thing as an unfair test, 
b. Many times exam questions tend to be so unrelated to course 
work that studying is really useless. 

11. a. Becoming a success is a matter of hard work, luck has little 

or nothing to do with it. 
b. Getting a good job depends mainly on being in the right place 
at the right time. 

12. a. The average citizen can have an influence in government 

decisions . 

b. This world is run by the few people in power, and there is not 
much the little guy can do about it. 

13. a. When I make plans, I am almost certain that I can make them 

work. 

b. It is not always wise to plan too far ahead because many 

things turn out to be a matter of good or bad fortune anyhow. 

14. a. There are certain people who are just no good, 
b. There is some good in everybody. 

15. a. In my case getting what^I want has little or nothing to do with 

luck. 

b. Many times we might just as well decide what to do by flipping 
a coin. 

16. a. Who gets to be the boss oft^n depends on who was lucky enough 

to be in the right place first, 
b. Getting people to do the right thing depends upon ability, luck 
has little or nothing to do with it. 

17. a. As far as world affairs are concerned, most of us are the 

victims of forces we can neither understand nor control, 
b. By taking an active part in political and social affairs the 
people can control world events. 

18. a. Most people don't realize the extent to which their lives are 

controlled by accidental happenings, 
b. There really is no such thing as "luck." 
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19. a. One should always be willing to admit mistakes, 
b. It is usually best to cover up one's mistakes. 

20. a. It is hard to know whether or not a person really likes you. 

b. How many friends you have depends on how nice a person you are. 

21. a. In the long run the bad things that happen to us are balanced 

by the good ones, 
b. Most misfortunes are the result of lack of ability, ignorance, 
laziness, or all three. 

22. a. With enough effort we can wipe out political corruption. 

b. It is difficult for people to have much control over the things 
politicians do in office. 

23. a. Sometimes I can't understand how teachers arrive at the grades 

they give. 

b. There is a direct connection between how hard I study and the 
grades I get. 

24. a. A good leader expects people to decide for themselves what they 

should do . 

b, A good leader makes it clear to everybody what their jobs are. 

25. a. Many times I feel that I have little influence over the things 

that happen to me. 
b. It is impossible for me to believe that chance or luck plays 
an important role in my life. 

26. a. People are lonely because they don't try to be friendly. 

b. There's not much use in trying too hard to please people, if 
they like you, they like you. 

27. a. There is too much emphasis on athletics in high school, 
b. Team sports are an excellent way to build character. 

28. a. What happens to me is my own doing. 

b. Sometimes I feel that I don't have enough control over the 
direction my life is taking. 

29. a. Most of the time I can't understand why. politicians behave the 

way they do. 

b. In the long run the people are responsible for bad government 
on a national as well as on a local level. 
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CIP INTERN INTERVIEW 
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Richard A. Gibboney Associates, Inc. 
8117 Old York Road 
Elkins Park, Pa. 19117 



CIP INTERN INTERVIEW 



Name: 



Date: 



Address: 



Birthdate: 



Home Phone: 

1. Sex: 1 
2 " 



Male 
Female 



Emergency Phone: 



2. Race: 1 
2 
3 



Black 
White 
Other 



3. Dropout?: 1 Yes 

2 No 



4. Interviewer: 



1 

2 
3 
4 
5 
6 
7 
8 



Herb Demby 
Angelika Melien 
Joan Clymer 
Leslie Booth 
Dave Smith 



******************************** 

I. INFORMATION AND ATTITUDE TOWARD PROGRAM 

1. When and how did you first hear about the Career Intern 
Program? 



When: 
1 

2 " 

3 ' 

4 

5 " 



Within last week 
Within last month 
Within last six 

months 
Within last year 
Other 



How: 

1 Friend or neighbor 

2 Family member 

3 ~ CIP intern or graduate 

4 School counselor 

5 UCEC representative 

6 UCEC brochure or pamphlet 

7 OIC contact or referral 

8 Other (specify) 



2. What made you decide to come for an interview here at UCEC? 

1 Interested in finding out about CIP 

2 ~ Definitely wants to attend CIP 

3 Thinks program will be better than other OIC or public 
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school programs 

4 Wants to get high school diploma 

5 Urged by significant other 

6 Other (specify) 

3. What do you think is the purpose of the Career Intern Program? 

4. Do you or do you not feel that this program may help you? 

1 _ Yes 

2 No 

5. Why? 



6. What does the word ''career*^ mean to you? 

1 Job or work (general) 

2 Lifetime occupation (something you want to do the rest 

of your life) 

3 Don' t know 

4 Other (specify) 

II. SCHOOL EXPERIENCE 

1. Are you now enrolled in school? 

1 Yes 

2 No 

2. Are you attending classes? 

1 Yes 

2 No 

3. Where are/were you enrolled? 

1 Germantown 

2 Roxborough 

3 Martin Luther King 

4 Other Philadelphia high school (specify) 

5 Alternative school 

6 Other (specify) 

4. What grade are/were you in? 

1 9th grade 

2 10th grade 
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3 11th grade 

4 12th grade 

5 Other (specify) 

5. If dropout, how long have you been out of school? 

1 Less than one month 

2 1-3 months 

3 ~ 4-6 months 

4 _ 7 months to one year 

5 More than one year 

6 Not applicable 

6. If dropout, what have you been doing since you left school? 

1 Staying at home 

2 Working 

3 Working and going to school 

4 Looking for a job 

5 Participating in other programs 

6 ~ Other (specify) 

7 Not applicable 

7. (Ask appropriate question, depending on whether applicant is 

or is not a dropout) 

Why did you leave your former school ?/Why do you wish to 
leave you present school? 

1 Tired of school 

2 Missed a lot of school because of "playing'^ 

3 Didn't like school atmosphere 

4 Discouraged by being left back 

5 Left to get a job; wanted/needed to earn money 

6 ~ Didn't expect to graduate 

7 School asked me to leave 

8 Wants to attend CIP/better than public school 

9 Personal problems/conflicts 

10 ^ Pregnant 

11 Felt teachers weren't doing their job 

12 Lack of personal self-discipline 

13 ^ Other (specify) 

8. Have other people encouraged you to either stay in school or 
leave school? 

1 Yes 

2 No 
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Stay in School : 



Leave School: 



1 Mother 

2 Father 

3 Parents 

4 Siblings 

5 Other relatives 

6 Girlfriend/Boyfriend 

7 Peers 

8 Other 

9 None 

How would you describe the way you get/got along with your 
teachers in school? Would you say it was: 

1 Excellent 

2 Good 

3 Fair 

4 Poor 

5 Other (specify) 

How would you describe the way you get/got along with other 
students? Would you say it was: 

1 Excellent 

2 Good 

3 Fair 

4 Poor 

5 Other (specify) 

Are/Were you able to see your couniselor when you wanted to? 

Yes 
No 

Sometimes 

Don't know (never tried; never needed to, etc.) 
Is/Was your counselor helpful to you? 

1 _ Yes 

2 No 

3 Sometimes 

4 Not applicable 

How is/was your counselor helpful to you? 

1 Assisted with curriculum or roster problems 

2 Assisted with teacher problems 



1 

1 


Mother 


2 


Father 


3 


Parents 


4 


Siblings 


5 


Other relatives 


6 


Girlfriend/Boyfriend 


7 


Peers 


8 


Other 


9 


None 




3 Assisted with personal problems 

4 Referred student to GIP or other programs 

5 "Just talked" with student 

6 Other (specify) 

7 Not applicable 

14. How do you feel about the courses which you have/had in 

school? 

1 Satisfied 

2 Not satisfied 

3 Required to take them 

4 Did or did not like specific courses 

5 Couldn't get desired courses 

6 Other (specify) 

15. Do you feel that the principal and main office staff are 

doing a good job running the school? . 

1 Yes 

2 No 

3 Don ' t know 

EXPECTATIONS OF INTERN 

1. Is it important for you to get a high school diploma? 

1 Yes 

2 No 

2 . Why? 

1 Necessary to get a job 

2 Necessary to go to college 

3 Personal goal 

4 To make significant other happy 

5 Other (specify) 

3. (If answer to question 1 is "yes" ask:) 

After you do get your high school diploma, do you expect to 
(If answer to question 1 is "no" ask:) 

After you have had the schooling you want, do you expect to 

a. Go to work? 

If yes, what kind of work would you expect to do? 

1 Don't know 

2 (record job title) 

3 Not applicable 



• Take additional education or vocational training? 

If yes, what kind of education or training do you expect 
to get? ^ 

1 1 year college 

2 2 years college 

3 4 years college 

4 Law school 

5 Medical school 

6 Other post-graduate school 

7 Apprenticeship 

8 Technical or vocational school 

9 On-the-job training 

10 Clerical training 

11 Nurses training 

12 Other (specify) 

13 Don't know 

14 Not applicable 



c. Both? ^ 

If yes, how do you expect to. do both? 

1 Hold part-time job and go to school 

2 Work for awhile, then go to school 

2 Learn while working (on-the-job training or other 

work- study) 

^ Work full-time, go to school part-time 

5 Other (specify) 

6 Not applicable 

d. Neither? 

If neither, probe for explanation. 

1 Doesn't know what she/he wants to do 

2 Other (specify) 

3 Not applicable 

What type of work do you expect to be doing 5 to 10 years 
from now? 

1 Don't know 

(record job title) 

If someone told you that you could have any kind of and as 
much education as you wanted, with nothing in your way, 
what kind of education would you most want to have? 

1 None 
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2 1 year college 

3 2 years college 

4 4 years college 

5 Law school 

6 Medical school 

7 Other post-graduate school 

8 Apprenticeship 

9 Technical or vocational school 

10 ~ On-the-job training 

11 Clerical training 

12 Nurses training 

13 Other (specify) 

14 Don't know 

5. If someone told you that you could do any kind of work you 

wanted, what kind of work would you most want to do? 

1 Don't know ^ . u ^ 

2 — (record job title) 

6. Are there any problems that you think might keep you from 

going as far in school as you would like to go? 

1 Yes 

2 No 

7a. If yes, what are these problems? 

1 Financial 

2 Not going to school 

3 Lack of personal self-discipline 

4 ]^ Other (specify) 

5 Not applicable 

7b. If yes, are these the kinds of problems that you have had in 
school in the past? 

1 Yes 

2 No 

3 _ No applicable 

8. If no, what do you feel have been your problems in school in 
the past, if any? 

1 Influence of ''friends'' 

2 Teacher/administration problems 

3 Not going to school 

4 No interest in school, bored 
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5 Other (specify) 

6 None 

7 Not applicable 

PROBLEMS AFF ECTING INTERN AND HIS/HER SCHOOLING 

1. Is studying at home a problem for you? 

1 _ Yes 

2 No 

2. If yes, how is. it a problem for you? 

1 Too crowded 

2 Too noisy 

3 No place to study 

4 Other (specify) 

5 Not applicable 

3. Is child care a problem for you? 

1 Yes 

2 No 

4. If yes, how is it a problem for you? 

1 Care of own child 

2 Care of siblings 

3 Care of "others" 

4 Other (specify) 

5 _ Not applicable 

5. Is health a problem for you? 

1 Yes 

2 No 

6. If yes, how is it a problem for you? 

1 Chronic disease 

2 Physical impairment 

3 Other (specify) 

4 Not applicable 

7. Are there any people (family members, friends) or any ganus 

making problems for you? ^ ^ ^ 

1 _ Yes 

2 No 
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8. If yes, who is making problems for you?- 

1 Mother 

2 Father 

3 Siblings 

4 Other relatives 

5 Boyftiend/Girl friend 
6 Peers 

7 Gangs 

8 Other (specify) 

9 Not applicable 

9. Have you ever had a problem finding a job? 

1 Yes 

2 No 

3 Never tried to find a job 

10. If yes, what problem have you had? 

1 Too young 

2 Doesn't have high school diploma 

3 3I[ "No openings" 

4 Poor health 

5 No "good" jobs 

6 Can't work full time 

7 ^ Other (specify) 

8 Not applicable 
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EXHIBIT 5 



CIP PARENT INTERVIEW 



61 



-65- 




Richard A. Gibboney Associates, Inc. 
8117 Old York Road 
Elkins Park, Pa. 19117 



CIP PARENT INTERVIEW 



Name: 
Address: 



Date: 



Birthdate: 



Home Phone: 



1. Relationship to Intern: 

1 Mother 

2 Father 

3 Sibling 

4 Guardian 

5 Other relative 

6 Other (specify) 



Emergency Phone: 
2. Interviewer: 



1 
2 
3 
4 
5 
6 
7 
8 



Herb Demby 
Angelika Melien 
Joan Clymer 
Leslie Booth 
Dave Smith 



********* 



********************** 
I. INFORMATION AND ATTITUDE TOWARD PROGRAM 

1. When and how did you first hear about the Career Intern 
Program? 

How: 

Son/Daughter 
Other family member 
Friend or neighbor 
CIP intern or. graduate 
School counselor 
UCEC representative 
UCEC brochure or pamphlet 
OIC contract or referral 
\ Other (specify) 

What do you think is the purpose of the Career Intern Program? 

1 To help students who need small groups to function well 

2 To help students who want to be helped 

3 — To help students adjust to the "world of work 

4 To educate youth 

C2 



When: 


How: 


1 


Within last week 1 


2 


" Within last month 2 


3 _ 


' Within last six 3 




months 4 


4 


Within last year 5 


5 _ 


" Other (specify) 6 

7 




8 
9 
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5 __ To help students earn a high school diploma 

0 To teach students a trade 

7 _ To make productive citizens of students who just can't 

"make it" in the public schools 

8 Other (specify) 

3. Do you or do you not think that this program may be good for 

your son/daughter? * 

1 _ Yes 
.. 2 No 

4. If yes, why do you feel this way? 

2 — ^hfiL'^^p'^^"^^^^' "^f*^" 'P^^^^^ attention, small groups 
^ Thinks CIP sounds good 

3 Thinks program will be better than other OIC or public 

school programs 

• _ Son/Daughter not doing well in school, needs change 
offered by CIP 

5 _ Son/Daughter lost interest in public school 

6 Other (specify) 

5. Did you urge your daughter/son to apply or did she/he take 

the initiative? 

1 Daughter/Son took the initiative 

2 Parent/Guardian urged daughter/son 

^ "We talked it over and decided together" 

4 Other (specify) 

6. Is your daughter/ son attending school now? 

1 Yes 

2 No 

EXPECTATIONS FOR CHILDREN 

1. Is it important to you that your son/ daughter get a high 

school diploma? s 6 » "-lkh 

1 _ Yes 

2 No 

2. If yes, why? 

1 Necessary to get a job 

2 Necessary to go to college 
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3 Personal goal 

4 Son/Daughter needs diploma to "make it" 

5 — Wants son/daughter to have the best education he/she 

can get 

6 Other (specify) 

3. (If answer to question 1 is "yes" ask:) 

After she/he does get her/his high school diploma, do you 

expect that she/he will: 
(If answer to question 1 is "no" ask:) 

After she/he finishes her/his schooling, do you expect that 
she/he will: 

a. Go to work? a ^ 
ifyes, what kind of work would you expect her/him to do 

1 Don't know 

2 Whatever daughter/ son wants to do 

3 — (record job title) 

4 No applicable 

b. Take additional education or training? 

lF"yes, what kind of education or training do you expect 
she/he will get? 

1 1 year college 

2 2 years college 

3 4 years college 

4 Law school 

5 Medical school 

6 Other post-graduate school 

7 Apprenticeship 

8 Technical or vocational school 

9 On-the-job training 

10 Clerical training 

11 Nurses training 

12 Other (specify) 

13 Don't know 

14 Whatever daughtej/son wants to dp 

15 Not applicable 



1 Hold part-time job and go to school 

2 Work for awhile, then go to school 

3 ~ Learn while working (on-the-job training or other 

work- study) 



c. 



Both? 

If both, probe for explanation. 



C4 




erJc 



-69- 



* Work full-time, go to school part-time 

5 Other (specify: 

6 Not applicable 

d. Neither? 

If neither, probe for explanation. 

^ sure what son/daughter will do 

2 Son/Daughter will be joining service 

3 Other (specify; 

4 Not applicable 

4. What type of work do you expect your son/daughter will be 

doing 5 to 10 years from now? 

1 Don * t know 

2 Whatever son/daughter wants to do 

^ — . (record job title) 

5. If your daughter/son could have any kind of education with 

nothing in her/his way, what kind of education would you 
most want her/him to have? 

1 None 

2 1 year college 

3 2 years college 

4 4 years college 

5 Law school 

6 Medical school 

7 Other post-graduate school 

8 Apprenticeship 

^ Technical or vocational school 

10 On-the-job training 

11 Clerical training 

12 Nurses training 

13 _ Other (specify: 

14 Don't know 



6. 



If your daughter/son could do any kind of work, what kind of 
work would you most want her/him to do? 



1 Don * t know 

2 Whatever daughter/son wants to do 



(record job title) 



Go 
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7. Are there any problems that you think might keep your son/ 
daughter from going as far in school as you would like 
him/her to go? 

1 Yes 

2 No 

8a. If yes, what are these problems? 

1 Financial 

2 Influence of ''friends" 

3 Gang problems 

4 Laziness 

5 Health 

6 Lack of interest in school, bored 

7 Other (specify) 

8 None 

9 Not applicable 

8b. If yes, are these the kinds of problems your son/daughter 
has had in the past? 

1 Yes 

2 No 

3 Don't know 

4 Not applicable 

9. If no, what do you feel have been your son's/daughter's 

problems in the past, if any? 

1 Influence of "friends" 

2 Gang problems 

3 Teacher/ administration problems 

4 ~ Not going to school 

5 "Playing" 

6 Health 

7 Lack of interest in school, bored 

8 ~ Other (specify) 

9 None 

10 Not applicable 

10. How would you describe the way your son/daughter gets/got 

along with his/her teachers? Would you say it was: 

1 Excellent 

2 Good 

3 Fair 

4 Poor 

5 Other (specify) r ^ 

vj O 
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How would you describe the way your daughter/son gets/got 
along with other students in school? Would you say it 
was : ^ 

1 Excellent 

2 Good 

3 Fair 

4 Poor 

5 Other (specify) 

Is/Was your daughter/son able to see her/his counselor when 
she/he wants/wanted to? 

1 Yes 

2 No 

3 Sometimes 

4 Don't know 

Is/Was his/her counselor helpful to him/her? 

1 Yes . 

2 No 

3 Sometimes 

4 Don't know 

5 Not^ applicable 

How is/was her/his counselor helpful? 

^ Assisted with curriculum or roster problems 

2 Assisted with teacher problems 

^ Assisted with personal problems 

^ Referred child to CIP or other programs 

^ Explained things child didn't understand 

6 _ Helped child find a job 

7 "Just talked" with child 

8 Other (specify) 

9 Not applicable 

How do you feel about the courses which your daughter/son 
has/had in school? 



1 Satisfied 

2 Not satisfied 

3 Child was required to take them 

Child didn't get courses she/he wanted 

5 Felt some courses were necessary 

6 _^ Other (specify) 

7 Don't know 



16. Do you feel the principal and main office staff are doing 
a good job in running the school? 

1 Yes 

2 No 

3 Don't know 

III. EDUCATION OF PARENT 

1. How many grades in school did you complete? 



1 Less than 9 grades 

2 9 grades 

3 10 grades 

4 11 grades 

5 12 grades 

6 Other (specify) 

2. Have you had any other additional schooling or training? 

1 _ Yes 

2 No 

3. If yes, what have you had? 

1 1 year college 

2 2 years college 

3 4 years college 

4 Post-graduate school (specify) 

5 Apprenticeship 

6 Technical or vocational school 

7 ~ On-the-job training 

8 Clerical training 

9 Nurses training 

10 Other (specify) 

11 Not applicable 

4. Would you have wanted any further schooling or training*! 
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1 Yes 

2 No 

5. If yes, what would you have liked to have? 

1 Finish high school 

2 1 year college 

3 2 years college 

4 4 years college 

GS 
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5 Post-graduate school (specify) 

6 Apprenticeship 

7 Technical or vocational school- 

8 On-the-job training 

9 Clerical training 

10 Nurses training 

11 Other (specify) 

12 Not applicable 

IV. BELONGING IN THE CONMJNITY 

1. Does the area you live in have a particular name? (Probe 
for name) 

1 Mt. Airy 

2 Colonial Gexmantown 

3 East .Falls 

4 West Dak Lane 

5 Roxborough 

6 Manayunk 

7 Brickyard 

8 _ Pulaski Town 

9 Germantown (non-specific) 

10 Other (specify) 



2. How long have you lived in this area? 

1 Less titan one year 

2 1-5 years 

3 6-10 years 

4 11-15 years 

5 16-20 years 

6 More than 20 years 



3. 



How long have you lived at the present address? 



1 Less than one year 

2 1-5 years 

3 6-10 years 

4 11-15 years 

5 16-20 years 

6 More than 20 years 

4. What do you feel are the good features of your area? 

1 Parks/recreational facilities 

2 Nice houses 

3 Quiet 
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4 Pleasant neighbors 

5 Nice shopping areas 

6 Good public transportation 

7 ~ Schools nearby 

8 "Strong" community 

9 ~ Other (specify) 
10 None 

5. Do you feel that there are any major problems in your area? 

1 Yes 

2 No 

6. If yes, what are they? 

1 Gang problems 

2 Dirty streets 

3 Theft 

4 Drugs 

5 Abandoned houses 

6 Other (specify) 

7 Not applicable 

7. Are you satisfied with your area? 

1 Yes 

2 No 

8. If no, what changes would you like to see made? 

1 Safer streets 

2 ~ Mo^^ youth supervision 

3 \ "Community face lifting" 

4 Other (specify) 

5 Not applicable 

9. Do you have any plans for moving elsewhere? 

1 _ Yes 

2 _2 No 

10. If yes, where are you planning to move, or where would you 
like to move? 

1 Out of the community 

2 ~ Out of the city 

3 Out of the state 

4 Out of the country 

70 
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5 Other (specify) 

6 Not applicable 

11. Do you belong to any clubs or organizations? 

1 Yes 

2 No 

12. If yes, to what organizations do you belong? 

1 Church group 

2 Political group 

3 Community group 

4 Neighborhood social group 

5 _ PTA 

6 Union/professional group 

7 Other (specify) 

8 Not applicable 

13. Do most of your relatives live in your area? 

1 Yes 

2 _ No 

14. Do most of your close friends live in your area? 

1 _ Yes 

2 No 

V. PROBLEMS AFFECTING INTERNS AND HER/HIS SCHOOLING 

1. Can you think of any problems that might keep your son/daughter 

from completing the Career Intern Program? 

1 Gang problems 

2 _^ Child care 

3 Financial problems 

4 Health 

5 Other (specify) 

6 None 

2. Complete FAMILY BACKGROUND INFORMATION form. 
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EXHIBIT 6 
CIP GRADUATE INTERN QUESTIONNAIRE 
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Richard A. Gibboney Associates, Inc. 
8117 Old York Road 
Elkins Park, Pa. 19117 



Name: 

Sex: a. 

Age: a. 
b. 
c . 



C!P GRADUATE INTERN QUESTIONNAIRE 

Date: 



Male 



b. 



16 or younger 

17 

18 



Female 

d. ^ 
e. 

f. " 



19 
20 
21 



g- 
h. 
i . 



22 
23 

24 or older 



CIP Entry Date: 



CIP Graduation Date: 
CIP Counselor: 



Total Time Spent at UCEC: 

a. Less than one month e. 

b. _ 1-2 months f . 

c. 3-4 months g. 

d. 5-6 months h. 



7-8 months 
9-10 months 
11-12 months 

More than 1 year (please specify) 



If working, answer part A below; if going to college (vocational, 
technical school, etc.), answer part B below; if unemployed, check 
part C below. 

A. Present Place of Employment: 



Address of place of employment: 
Name of job supervisor: 



B. Present College (or Vocational School, Technical School, etc.) 
Being Attended: 



Address of college: 



Name of counselor or advisor at college: 

Present Major Subject Being Studied: 

C. Unemployed: 

i i 
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Please answer the following questions as completely as possible. 
Youii responses will be of great value to the Career Intern Program. 
You may check (✓) more than one answer for each question if you wish . 

1. What were you doing just before you ca.-e into the Career Intern 
Program? 

a. Going to a public school 

b. Going to a private school 

c. Going to an alternative school (Job Corps, etc.) 

d. Working 

e. Staying at home 

f . Other (please explain) 



2. Had you officially dropped out of public school before you 

decided to attend UCEC? 

a. Yes 

b. No 

3. If "no," were you regularly attending classes? 

a. Yes 

b. No 

4. If "yes," where were you attending classes? (Please fill in 

space with name of school you were attending.) 

5. What was the last school grade that you completed before coming 





to UCEC? 


a. 


9th 


b. 


10th 


c. 


11th 


d. 


12th 


e. 


Other 



(please specify) 



6. Had you thought about what kind of career you would like to have 

before coming to UCEC? 

a. Yes 

b. No 

7. If "yes," what career had you thought about? (Please fill in 

space with career choice.) 

IK) 



ERIC 



-82- 



8. Did you know what kind of education and/or training you needed 

for this career? 

a. Yes 

b. No 

9. Did you feel that you would be able to have this career someday, 

or were you just thinking about it? 

a. Just thinking about it; didn't know if I could get this 

career or not 

b. Knew I would be able to get this career if I worked for it 

c. Other (please explain) 



10. Did anyone close to you (family member, friend, etc.) have the 

same career that you were thinking of getting into? 

a. Yes 

b. No 

11. If ^yes," who had this same career? 

a. Mother 

b. Father 

c. Brother 

d. Sister 

e. Other relative 

f . Boyfriend 

g. Girlfriend 

h. Other (please specify) 

12. Once you finished Career Awareness classes, were you still 

interested in this career? 

a. Yes 

b. No 

13. If '*no,'' why not? 

a. Found out I would need more schooling than I wanted in 

order to get this career. 

b. Wasn't satisfied with the pay I found out I would get in 

this career 

c. Wasn't satisfied with the work I found out I would have 

to do in this career 

d. Learned about a career I thought I would like better 

e. _ Other (please explain) 
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14. What career did you finally decide to choose after your Career 

Awareness classes? (Please fill in space with career choice.) 

15. Is this the same career that you had thought about before you 

came into CIP? 

a. Yes 

b. No 

c. I didn't have a particular career in mind before I came 

to UCEC 

d. _ Other (please explain) 

16. Was a Career Development Plan worked on with you while you were 

attending UCEC? 

a. Yes 

b . No 

17. Who worked on this Career Development Plan with you? 

a. Counselor 

b. Teachers 

c. Career Advisor 

d. Other (please specify) 

e. No one 

18. Did you follow your Career Development Plan in working toward 

: your chosen career? 

a. Yes 

b. No 

19. If "no/* why didn't you follow the plan? 

a. I didn't have a Career Development Plan to follow 

b. My Career Development Plan C'-^n't serve my needs. 

c. My Career Development Plan w^s too complicated. 

d. Nobody cared if I followed the Career Development Plan 

or not 

e. Other (please explain) 

20. Do you think your Career Development Plan was useful to you? 

a. Yes 

b. No 

c. Didn't have one 
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21. Could you have done just as well in working toward your career 
without It? 



a. Yes 

b. No 

22. Did you have any Hands-On experiences? 

a. ^ Yes 

b. '^m 

23. If "yes,*' how many Hands -On experiences did you have? 

a. One 

b. Two 

c. _ Three 

d. Four 

e. Five 

f . Six 

g. Seven 

h. Eight 

i. More than eight (please specify) 

24. Do you feel that these helped you in choosing a career? 

a. Yes 

b. _ No 

c. [ Didn't have any Hands-On experiences 

25. Are you happy that you attended the Career Intern Program? 

a. _ Yes 

b. No 

26. If "yes," why are you happy that you attended CIP? 

a. CIP got me interested in education again 

b. ~ CIP helped me look at myself in a new and better way 

c. CIP taught me how to get along with others better 

d. CIP helped me choose a career for myself 

e. CIP gave me a new outlook on the "world of work" 

f . ~ CIP got me off the streets and into a job (or into 

college, etc.) 

g. Other (please explain) 

27. If "no," why aren't you happy that you attended CIP? 

a. Didn't get anything out of the program, felt it was a 

waste of time 
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Would have done just as well in public school * 

Wasn't able to get the job I thought I could get when I 

finished CIP 

CIP didn't prepare me for the job I got, so I quit 

CIP didn't prepare me to go to college (or vocational 

school, etc.)> so I quit 
f . Other (please explain) 

28. Do you think the Career Intern Program helped you in any way? 

a. Yes 

b. No 

29. If »»yes," how did it help you? 

a. Helped me learn more about myself 

b. Gave me more self-confidence 

c. Helped me get a high school diploma 

d. Taught me to enjoy learning again 

Taught me how to get along better with others • 

f . Gave me more faith in schools 

g. Helped me find a job 

h. Helped me get into college (or into a technical or 

vocational school, etc.) 

i- Helped me solve; my personal problems 

j ' Made me aware of careers and the ''world of work" 

k. ^ Taught me how to keep a job once I have it 

I- Gave me more faith in teachers, counselors, etc. 

m. Other (please explain) 



30. Who in the program was the most helpful to you? (Please select 
only one of the following) 



a. Counselor 

b. Teachers 

c. Career Advisor 

d. Other (please specify) 

e. No one 

31. Do you think you could have done better in any other school or 
any other program? . 

a. Yes 

b . No 
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32. If ''yes/' which school or program? (Fill in space with name 
of school or program.) 



33. Would you recommend this program to your friends? 



a. Yes 

b. No 



34. What are you doing now? 



a. Working 

b. Staying at home 

c. Going to college 

d. Going to a technical of vocational school 

e. ~ Receiving on-the-job training 

f . Other (please explain) 

35. What career or job do you have or are you working toward? 

(Fill in space with name of career or job.) 

36. Is this the career or job you were preparing yourself for while 

you were at UCEC? 

a. Yes 

b . No 

37. If "no/' why do you have or are you working toward a different 

career or job than the one you were preparing yourself for 
at UCEC? 

a. I was never able to get the job I 

was preparing myself for at UCEC 

b. I didn't like the job I prepared 

myself for at UCEC, so I quit 

c. - I had difficulties in the job I pre- 

If you are working pared myself for at UCEC, so I quit 

or staying at home: d. I found a job I thought I would like 

better than the one I prepared for 
at UCEC 

e. I cannot get any sort of a job 

because there seem to be "no 
openings" 

f . I cannot work because of personal 

reasons 

g. Other (please explain) 

8 V J 
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a. I didn't like studying the career 

that I was preparing myself for 
at UCEC, so I changed majors 

I didn't like studying the career 

If you were or are that I was preparing myself for 

going to college, at UCEC, so I quit school 

vocational school, c. I had to quit school for personal 

Qtc. : reasons 

d. I decided I would rather work than 

go to school 
e- Other (please explain) 



38. Are you satisfied with the career or job you have or are working 

toward? 

a. Yes 

b . No 

39. If "no," why not? 

The career or job isn't what I expected it to be 
I don't make enough money 
I don't like the people I work with 
The career or job isn't challenging enough 
The career or job takes up too much of my time 
I don't like studying this career 
Other (please explain) 



40. Is there any other career or job that you would rather have or 

study if you had the opportunity? 

a. Yes 

b. No 

41. If "yes," what career or job would you rather have or study? 

(Fill in space with name of career or job.) 



42. Why would you prefer this career or job? 

a . Better pay 

b. Better hours 

c. More challenging work 

y d. Nicer people to work with 

More interesting work 

f • Other (please explain) 
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43. Do you think you will ever have or study this career or job 

(the one you named in question 41)? 

a. Yes 

b. No 

44. If "no," why not? 

a. It's only a dream I have 

b. I need more education than I can pay for to get it 

c. I have no time to get the extra education I need, because 

I have to work to support myself 

'd. I don't know how to go about getting a career or job like 

this 

e. I know I don't have the skill or aptitude for a career or 

job like this 

f. Other (please explain) 



ANSWER THE FOLLOWING QUESTIONS ONLY IF YOU ARE WORKING (Otherwise , 
go to question 58) : 

45. Is it possible to get a promotion on the job you have? 

a. Yes 

b. No 

46. Have you had a promotion on your job? 

a. Yes (specify how many promotions here) 

b. ~ No 

47. Do you expect to get a promotion on your job in the near future? 

a. Yes 

b. No 

48. Have you had a raise in pay on your job? 

a. _ Yes 

b. No 

49. Do you expect to get a raise in pay on your job in the near 

future? 

a. Yes 

b. No 
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50. How long have you worked at your present job? 

Less than one month 
1-3 months 
4-6 months 
7-9 months 
10-12 months 
1-1^^ years 
1^-2 years 
More than 2 years 
Other (please specify) 

Is this the same job you have had since you left UCEC? 

a. Yes 

b'. No 

If "no,'* how many other jobs have you had since you left UCEC? 

One 
Two 
Three 
Four 

More than four (please explain) 

53. If you have changed jobs since your first job after graduating 

from UCEC, what made you change jobs? 

Was offered better pay at another job 
Was offered a more interesting job 
Was tired of my old job, so I quit 
Was fired from my old job 
Personal reasons 
Other (please explain) 

54. Are you happy with your present job? 

a. Yes 

b. No 

55. If *'no," are you looking for a new job? 

a. _ Yes 

b. No 
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56. 



What kind of a job are you looking for? (Please fill in space 
with name of job.) 



57. What kind of work do you think you will be doing 5 or 10 years 

from now? 

a. . -r- 

(Please fill in space with name of job or career) 

b. Will not be working 

c. Other (please explain) 

d. Don't know 

Please go to question 66. 

ANSWER THE FOLLOWING ONL.Y IF YOU ARE ATTENDING COLLEGE, VOCATIONAL 
SCHOOL, ETC.: 

58. Are you satisfied with the college (or vocational or technical 

school, etc.) you are attending? 

a. Yes 

b. No 

59. If "no," why not? 

Don't like my subject major 
Don't like the school atmosphere 
Can't get myself motivated to do the work 
Don't find the courses interesting 
Work is too difficult for me to do well 
Don't like the people I'm with 
Other (please explain) 

60. Do you plan to continue in college (vocational school, etc.) 

until you graduate or complete the program successfully? 

a. Yes 

b. No 

61. Have you changed your major course of study since you started 

college (vocational school, etc.)? 

a. Yes 

b. No 
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many times have you changed your major course of study? 



a. One time 

b. Two times 

c. More than two times (please specify) 




long have you been attending college (or vocational school. 

C.J? * 



a. 



Less than one month 



c. 



1-3 months 
4-6 months 
7-9 months 



e. 



10-12 months 



f. 

g. 
h. 



years 
lH-2 years 
2-2h years 



i- Other (please specify) 

Do you feel you would have been accepted into college (. 
vocational school, etc.) without the help of UCEC? 



How are you doing compared to the other students in your 
college (vocational or technical school, etc.) classes? 

I do better than most other students 

I do about as well as the other students 

^- I don't do quite as well as most other students 

d. Other (please explain) 



Does anyone from UCEC still keep in touch with you to see how 
you are doing since you left UCEC? 

a. Yes 

b. No 

If 'yes,'' who keeps in touch with you? 

a. CIP counselor 

b. CIP teacher 

c. CIP advisor 

d. Other CIP person (please specify who) 



a. 



Yes 
No 



68. How often have you been contacted since you left UCEC? 

a. One time 

b. Two times 

c. Three times 

d. Four times 

e. Other (please specify) 



EXHIBIT 7 



EMPLOYER QUESTIONNAIRE: GRADUATE INTERNS - FOLLOW-UP 
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Richard A. Gibboney Associates, Inc. 
8117 Old York Road 
Elkins Park, Pa. 19117 



EMPLOYER QUESTIONNAIRE: GRADUATE INTERNS - FOLLOW-UP 



To be completed by direct supervisor of 

please. 



Name of Supervisor: 
Job Title: 



Date : 



Name of Firm or Company: 



Address of Firm or Company: 



Job Title of CIP Graduate Employed: 



Please answer the following questions as completely as possible. You 
may check (✓) more than one answer for each question, if you wish. 

1. How^long has the CIP graduate named above been working for you 

and/or your company? 

a. Less than one month 

b. 1-2 months 

c. 3-4 months 

d. 5-6 months 

e. 7-8 months 

f. 9-10 months 

g. 11-12 months 

h. ~ More than one year (please specify) 

2. Are you satisfied with his/her attitude toward the job? 

a. _ Yes 

b. _ No 

3. If *'yes,'^ why are you satisfied? 

a. She/he is punctual for work 

b. ~ She/he is usually easy to get along with 

c. — She/he accepts her/his work assignments willingly 
d! ~ She/he is neat and clean in her/his appearance 

e. ~ She/he is eager to do a ^'good job" 

f . Other (please explain) 
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4. If ♦'no/' why aren't you satisfied? 



^- He/she is usually late for work 

b. _ He/she misses a great deal of work because of ''illness'^ 

c. _ He/she does not get along with his/her co-workers 

d. He/she is never satisfied with work assignments given to 
him/her 

®- He/she is sloppy in appearance 

f. _ He/she doesn't care whether he/she gets hi^/her job done 

well or not 
g- Other (please explain) 

Are you satisfied with the way she/he is performing on the job? 

a. _ Yes 

b. No 

If *Ves," why are you satisfied? 

_ He/she works quickly and efficiently 

_ He/she is conscientious about the quality of his/her work 
_ He/she can carry out work assignments without constant 
supervision 

^ He/she performs his/her job as well as it can be performed 
by anyone ^ 

_ He/she puts in extra time to complete his/her work 
assignments \ , 
Other (please explain) 

7. If "no," why aren't you satisfied? 

She/he works too slowly 

b. She/he is inefficient 

^- Her/his work is of poor quality 

d. _ She/he needs constant supervision to carry out her/his work 

assignments 

e. _ She/he puts in the least amount of work and time she/he 

can get away with 
f • Other (please explain) 



a. 
b. 
c. 

d. 

e. 



Has he/she received a raise since he/she began working with you? 

a. Yes 

b. No 
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If "no," do you anticipate her/his receiving a raise in the near 
future? 



a. Yes 

b. No 



Is it possible for him/her to receive a promotion on his/her job? 



a. _ Yes 

b. No 



Has she/he received a promotion since she/he began working for 
you and/or your company? 



a. Yes 

b. No 



If "no," do you anticipate his/her receiving a promotion in the 
near future? 



a. Yes 

b. No 



How would you rate the quality of her/his work in comparisQn to 
that of the other people working for you? 

a. Significantly above average 

b. Above average 

c. Average 

d. Below average 

e. Significantly below average 

f . Other (please explain) 

How well prepared do you think he/she was for the job when he/she 
was first hired? 

a. He/she had the academic background, but not the skill 

necessary for the job 

b. _ He/she had the skill, but not the academic background 

necessary for the job 

c. He/she had both the skill and the academic background 

necessary for the job , . . i a 

d He/she had neither the skill nor the academic background 

~ necessary"f:r the job, but showed great interest and 
willingness to learn 

e. Other (please explain) u- j 

f. "Don't know, wasn't here when he/she was first hired 
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'^^Hit^^^?^ """""^ '"^^ company's) einployment 

Ce^te^?^ graduating from the Urban Career Education 



a. Yes 

b. No 



16. If "yes," dia anyone from the Urban Career Education Center 
recommend him/her? v-cucet 



a. __ Yes 

b. No 



17. If "yes," who from the Center recommended her/him? fPlease fill 

in space with name of person and position.) 

18. If you answered "no" to question 15, where did he/she work before 

coming into your (or your company's) employment? (PUase f in 
Iml'y^LT.T '"'^''^"^ °' his/hL previous 'pJ::rof^'' 



19. Do you enjoy having her/him work for you? 



20. 



a. Yes 

b. No 

c. Indifferent 



Do you plan on keeping him/her employed for a good deal of time 
to come, barring unforeseen circumstances? 



a. Yes 

b. No 



"°X ori?/?oir'°"™'?^ '° ^"'""^ employers? (Place an 

X on the following line scale to indicate your rating.) • 



Would highly Would recommend would not 

recommend with som^ 

witn some recommend 

reservations all 
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Please make any additional comments which may (1) clarify your 
earlier responses or (2) supply further information which you 
think is pertinent. 
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SECTION B 



WHAT THE INTERNS ARE LIKE WHEN THEY ENTER CIP: 
FREQUENCY DISTRIBUTIONS OF PRE-TEST MEASURES 



The tables in this section of Appendix I present the raw data upon 
which the discussion in Chapter Four of the main body of the report . 
is based. Their order follows that of the presentation in Chapter 
Four. 

The sample consists of all applicants entered into the randomiza- 
tion lottery. Data collection was hampered by several constraints 
resulting in a good deal of missing data. For example, not all re- 
spondents followed instructions, invalidating some scales; and not 
all respondents completed all scales. The N's thus range from 118 
to 140. In each case the maximum number of available cases was 
included. 

Below are listed the page numbers of Volume I to which each table in 
this section of Volume II refers: 

Volume I Volume II 

Page 67 Table B.l 

Page 68 Table B.2 

Page 71 Table B.3 

Page 73 Table B.4 

, Page 74 Table B.5 

Page 76 Table B.6 

Page 77 Table B.7 

Page 79 Table B.8 

Page 82 Table B.9 

Page 84 Table B.IO 

Page 85 Table B.ll 
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SECTION C 



GAINS MADE BY INTERNS OVER THE FIRST TEN WEEKS: 
POOLED FREQUENCY DISTRIBUTIONS OF PRE- AND POST-TESTS FOR 
COHORTS ENTERING JANUARY AND JUNE 1974 



Tables C.la - C.8b provide basic data in support of the discussion 
in Chapter Five of the main body of this report, and the order of 
their presentation reflects the organization of the same chapter. 
All usable pre- and post- test data for the experimental and control 
groups are included. Thus, the N's for the pre-tests for the experi- 
mental group range from 72 to 80, and for the control group, from 
42 to 50. Total numbers of post-test scores range from 43 to 72 for 
the experimental group and from 29 to 30 for the controls. 

Below are listed the page numbers of Volume I to which each table in 
this section of Volume II refers: 



Volume I 



Volume II 



Page 102 
Page 103 
Page 104 
Page 106 
Page 107 
Page 112 



Tables 
Tables 
Tables 
Tables 
Tables 
Tables 



C.la - C.3b 
C.4a 5 C.4b 
C.5a 5 C.5b 
C.6a 5 C.6b 
C.7a 5 C.7b 
G.Sa § C.8b 
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SECTION D 



DIFFERENTIAL GAINS MADE BY SUBGROUPS 
OF THE JANUARY AND JUNE COHORTS OVER THE FIRST TEN WEEKS 



Tables in this section provide supporting data for the discussion 
of intern subgroups (dropouts/non-dropouts, high readers/low readers, 
and males/ females) in Chapter Six, Volume I, of this report, and 
they appear in the order suggested by that discussion. 

Here, as before, all usable data is included in the tables. In ad- 
dition to the problems mentioned in the introduction to Section B 
with regard to fluctuating N's, three other problems are associated 
with this section. Of greatest magnitude is the fact that on the 
post-tests, a number of interns failed to write their names on the 
instruments- information necessary to categorize individuals accord- 
ing to subgroups. In the case of tables dealing with dropouts/ 
non-dropouts, another discrepancy will be noted between the N s 
of corresponding tables in Section C (presenting data on the intern 
group as a whole) and Section D, because the status of three mdi- 
viduals could not be determined. Their scores are thus not included 
here. Finally, with regard to Tables D.lla and D.llb for high 
and low readers, the N's are explained by a combination of two 
factors- (1) a few individuals taking that measure had not taken 
the original reading test and could not be so categorized, and (2) 
scores are included in the post-test scales for individuals whether 
or not they took the pre-test measure. 

On the tables following, £ values are noted only when t-tests reached 
significant levels. 

Below are listed the page numbers of Volume I to which each table in 
this section of Volume II refers: 



Volume I 

Page 114 
Page 115 
Page 116 
Page 117 



Volume II 

Tables D.la - D.3b 

Tables D.4a - D.7b 

Tables D.8 - D.llb 

Tables D.12a - D.14b 
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THE ETHNOGRAPHIC COMPONENT 



-161- 



THE ETHNOGRAPHIC DESIGN 



To facilitate a more complete evaluation of the Career Intern Pro- 
gram (CIP) , an anthropologist was employed to design an ethnographic 
component to supplement the original experimental design. Because 
they are concerned to explain underlying cultural processes and are 
trained in participant-observation methods of data gathering, it was 
reasoned that anthropologists, working in conjunction with experi- 
mentally-oriented evaluators, could provide both a picture of what 
the CIP is like from the perspective of participants and important 
evaluative data which might be missed by the more traditional evalu- 
ation design. 

As originally designed, the ethnographic component proposed to an- 
swer three basic questions: 

1. What is it like, from an inside perspective, to be a 
participant in the school? 

2. What difference does participation in the school niake 
in an individual's life? 

3. What are the significant social dynamics making the 
school what it is? 

In seeking answers to these questions, the anthropologists proposed 
focusing on a number of cultural phenomena of traditional concern 
to ethnography. Specifically, these were: (1) the ethos of the 
school, (2) the operational decision-making processes, (3) ditter- 
ing perceptions of the program on the part of various kinds of par- 
ticipants, and (4) the underlying social structure. The rationale 
for this approach was that the underlying culture determined the 
on-the-ground behavior of participants and, ultimately, the degree 
o'f success enjoyed by the school in meeting its stated objectives. 

These foci were chosen as a basis for organizing the field notes of 
the investigators, which would consist of detailed descriptions of 
behavior, and as the basis for developing a more specific set of ques- 
tions dealing with actual participant behaviors. Since, for interns, 
the program was divided into five specific phases, i.e., recruitment, 
intake and orientation, career awareness,. career exploration, and 
career specialization, a field guide was prepared suggesting what 
specific behaviors during each of these levels would be affected by 
the underlying cultural processes. The guide thus provided a set 
of simple questions the field investigator would seek to answer. 
(A copy of the field guide is attached to this appendix as Exhibit I.) 

The tasks of gathering and analyzing the data called for the servi, - 
of two anthropologists. One would serve as field investigator and 
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the second as field director. The field investigator was to choose 
(in conjunction with progrmn personnel) a role in the program she/he 
was qualified to fill. From this perspective he/she would be in a 
position to actively participate in school activities and, at the 
same time, make and record detailed observations on a variety of 
school behaviors. It was hoped that as the evaluation progressed, 
the field investigator would change roles in order to gather data 
from different perspectives. For example, this individual might 
serve as a teacher for part of the time, then as a counselor or an 
inservice training coordinator. The exact role was to be determined 
by program constraints and the qualifications of the investigator. 

The field director would be less directly involved in field research. 
His/her primary job would be to coordinate and direct the activities 
of the field investigator. The director would deliberately attempt 
to maintain some distance so as to be able to provide a more holistic 
perspective, but would be ultimately responsible for the completeness 
of the data analysis. In addition, she/he would serve as liaison 
between the evaluation team and program administrators, thus provid- 
ing a buffer for the fieldworker. 

While the fieldworker was collecting data on the ongoing processes 
of the program, both this person and the field director were to uti- 
lize a second technique to obtain other types of data. Making use 
of an extended case study approach, they would collect detailed 
descriptions of significant events, both episodic and continuous. 
Data from these descriptions would crosscut those gleaned from the 
ongoing participation and would provide the investigators with two 
significantly different perspectives. These events would include 
graduation, the fieldworker' s first days in the program, the firing 
of staff, reaction to important visitors, and perhaps most signifi- 
cantly, selected students' participation in the program from the 
beginning of the evaluation period to the end. 

To facilitate analysis of the data, careful field notes were to be 
kept by the field investigator. For the most part, these would be 
dictated on-site and then typed and filed, by a- secretary. These 
notes would be reviewed regularly by the field director, enabling 
him/her to develop an overall picture of the ongoing investigation 
and to Identify areas for further investigation. 

The field director's analysis would not only serve as the basis for 
the tinal report, but (since the program was in a developmental 
?nf L^!! • the formative mode) would form the basis 

tor teeding information and recommendations back to program 
administrators. ^ 

According to the original design the final product would consist of 
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an ethnographic description of the program as viewed from the^per- 
spective of participants, with most emphasis on interns. Such a 
description would serve to explain and supplement the results of 
the experimental evaluation and would permit a comparison of the 
program as it existed on paper and as it really operated. 

THE ACTUAL ETHNOGRAPHIC EVALUATION 

For the most part, the basic evaluation design proved conceptually 
sound and the evaluation proceeded as proposed. However, as is to 
be expected, implementing the actual investigation called for several 
important changes, most involving additions. Following is a brief 
discussion of the actual field evaluator's role and the significant 
changes made. 

Field I nvestigator's Role 

A doctoral candidate in anthropology with a strong academic back- 
ground and experience in urban education was hired as field investi- 
gator In consultation between the field director and program 
administrators, it was decided that this individual should serve as 
a reading specialist. Her/his first task was to create a reading 
laboratory. Since such a position existed in the original program 
design but had remained unfilled, and since this role filled a real 
need in the school, teachers and counselors cooperated by sending 
problem readers for tutoring. The role proved to be a fruitful 
one From the perspective it afforded, the field investigator was 
able to observe a wide range of activities (including staff meetings 
in which he/she could participate fully), thereby enjoying intimate 
involvement with interns, instructors, counselors, administrators, 
and service staff. 

Focus on Communication Networks and Processes 

As the investigation progressed, it became increasingly apparent 
that there were a number of problems in the program not directly 
related to any one of the four underlying cultural phenomena sug- 
gested as foci in the original design. Since these all appeared to 
stem from basic problems in communication, it was decided to add as 
a fifth focus a description of communication networks and processes. 
Accordingly, an attempt was made to describe the formal and informal 
communication networks existing between participants and to record 
incidents indicating blockages in communication. 

This investigation led to the formulation of several recommendations 
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for changes in the administration of the program and in the struc- 
turing of the instructional-counseling components. The other cul- 
tural, foci continued to be useful in structuring the investigation. 



Reports to the Program Manager 

The presence of an on-site evaluator, actively participating in the 
program, proved a valuable asset to the UCEC Program Manager in the 
development of a stabilized program. The field investigator was in 
a position to describe problems and to monitor reactions to program 
clianges not accessible to the Manager. 

Therefore, in addition to the informal reports to program staff 
called for in the original design, it was determined that the two 
anthropologists should meet on a regulal- basis with the Program 
Manager and staff to review their findings with respect to program 
development. Furthermore, three written reports were prepared de- 
scribing and documenting program problems and strengths and offer- 
ing specific recommendations. 



Case Studies 



The original design called for the focus on experiences of a number 
of individual students as "ongoing events" in the program as part 
of the extended case studies component. As the investigation pro- 
gressed, however, it became apparent that to present a realistic 
description of what it was like to be a typical intern in CIP would 
require gathering a number of detailed profiles of specific students. 
A sample of five interns, representing as much diversity as possible, 
was therefore chosen for detailed study. Their records were perused; 
they were interviewed in a number of different contexts; and they 
were observed in class and in their leisure activites. In addition, 
staff were interviewed concerning them. The results of this investi- 
gation were analyzed as a set of case studies (see Chapter Three) . 
This became an extremely useful technique for getting a feel for 
what it is really like to be a student in the CIP. 

Integration of Ethnographic an^ Experimental Investigations 

In the original evaluation design the ethnographic component was 
seen as complementing the experimental, although the two were de- 
signed to proceed independently of each other. Furthermore, each 
was to submit a separate final report. As the evaluation proceeded, 
however, it became apparent that the two modes not only complemented 
each other, but that a closer relationship between those responsible 
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for each component of the design could greatly enhance each other's 
data gathering and analysis capabilities. Therefore, the two ap- 
proaches gradually were merged- At first, this merger took the form 
of a number of informal discussions between the anthropologists and 
the experimental evaluators, during which results of their investiga- 
tions were shared and discussed- Later, the anthropologists began 
to share some of the tasks of the experimental evaluators, such as 
participating in intake interviews and classroom observations- It 
was discovered that the previous training and perspective of the an- 
thropologists provided additional insights into the behavior of 
school participants - 

As the analysis progressed, the anthropologists were able to offer 
explanations for specific outcomes reported by the experimental evalu- 
ators, and the results of the latter in turn suggested areas the 
anthropologists should investigate- As a result of this coopera- 
tion, it was decided to combine the results of the two evaluations 
into one report - 

Based upon this experience in the formative evaluation, the summative 
design makes no explicit distinction between the experimental and 
ethnographic modes. Both the anthropologists and the experimental 
evaluators will be involved in gathering data, making analyses, and 
reporting the results for each evaluative task- 
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EXHIBIT 1 



FIELD GUIDE FOR ETHNOGRAFJ^rC r-:*^lUATION 



FOCUS ON ETHOS 
Recruitment 



1. Is there an '»ideal" student in the heads of recruiters? 

2. How is the program conceptualized in presentations to 
potential interns? 

3. What questions do parents and students ask about the kind 
of organization the Urban Career Education Center is? 

4. Is participation in CIP seen as incompatible with the 
ethos of certain social groups potential interns are mem- 
bers of? 
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Intake and Orientation 

1. How do the interviewing counselors present the program? 

2. What prior conceptions of the program do parents and 
recruits articulate by the questions they pose and in- 
formation they offer? 

3. What do teachers and staff present as important about 
the program in the orientation sessions, both overtly 
and by their comportment? 



C areer Awareness 

1, What kinds of things do staff people appeal to as motivation, 
ensuring cooperation, dedication, and incentive? 

2, What kinds of classroom rituals develop reflecting an under- 
lying OIC mythology? 

3, What, phenomenologically, is focused on in lessons reflect- 
ing the ethos? 
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4. Is there a hidden curriculum stressing the ethos, and 
how is it articulated so students are aware of it? 

5. What are the real, as opposed to stated, criteria used 
in assessing Phase I, and do they reflect concern for 
students sharing the ethos? 



Career Exploration 

1. How are different career possibilities pushed or neglected 
because they are not really as highly respected by the staff? 

2. How does the actual, in-class fusing of academics ^nd careers 
reflect the ethos of OICs/A? 

3. In the ii^dividualized packet program, are outsiders chosen to 
participate because they conform to some *'ideal,'* and how is 
this useful or limiting? 



Career Specialization 

1. How is the mystique of the program reflected in the tracking 
decisions of the interns? 

2. How ore the three tracks presented differently, and how are 
the interns in each track treated differently by the staff? 

3. What kinds of expectations are instilled in interns that they 
feel they have to "live up to" as graduates of CIP? 

4. What kinds of jobs are chosen--are they worthwhile, respect- 
able jobs, or "fringe-type" jobs? 

5. What kinds of educational opportunities become available to 
those who choose the academic track? 



FOCUS ON DECISION-MAKING 
Recruitment 

1. What kinds oF'covert/overt pressures are applied to get po- 
tential interns to enter? 

2. Are certain types covertly discouraged from accepting 
invitations? 

1 h i) 
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3. How are decisions made to invite interns, and are these 
decisions really consonant with the stated aims of the 
CIP? 

4. What is the process of consulting and searching an intern or 
decliner goes through in making the decision? 

5. What effects do the dec is ion -making processes have on 
determining the composition and flavor of the CIP? 



Intake and Orientation 

(Although important decisions will be made at this stage, the 
specific things to look for will have to emerge from the first 
formative run-through of the evaluation.) 



Career Awareness 

1. How are decisions made about possible career opportunities to 
be presented? 

2. Who emerges, from the intern's standpoint, as having really 
weighty or politically astute opinions? 

(Again, most of the important things to look for here will have 
to emerge from the first stages of the evaluation.) 



Career Exploration 

1. How are decisions made as to which careers to explore in depth 

2. What is the process of consultation and investigation? 

3. What factors make the determinations, and how are. the 
choices limited by the processes made available? 



Career Specialization 

1. How are decisions made with respect to tracking? 

2. What roles do personal preferences, aptitudes, program 
resources, staff attitudes, etc., have in affecting track- 
ing choices? 

3. What kinds of outside pressures are involved, and how are 
they dealt with by interns and staff? 



4. What kinds of questions are asked of whom in making decisions? 



General 

1. How is the decisicii-making process instilled in interns useful 
or relevant to her/his wider life outside the classroom and 
after graduation? 

FOCUS ON DIFFERING PERCEPTIONS 
Recruitment 

1. How do potential interns see the CIP, and how do these per- 
ceptions affect entering decisions? 

2. How do potential interns perceive the differences between 
Germantown High School, other alternatives, and the CIP? 

3. What kinds of potential interns are "hustled,'' and what 
kinds are surreptitiously discouraged? 

4. Do counselors and instructors informally recruit friends and 
acquaintances, or do they discourage them? 



Intake and Orientation 

1. What steps are taken to challenge and reshape recruits' 
and parents' ideas about the program? 

2. Is the continuity of the program as an educational ex- 
perience or its innovative aspects stressed in pre- 
sentations? 

3. Do staff compare CIP favorably or unfavorably with Germantown 
High School and/or other alternative schools? 

4. How do official, overt preachments about the program conflict 
or agree with actual behavior? 

5. Do interns feel apologetic vis-a-vis peers outside in admit- 
ting participation? 



Career Awareness 

1. Are academic careers given as much respectability as non- 
academic? 



2. In informal discussions, do interns exhibit a real aware- 
ness of what is going on, or are they bewildered? 

3. Do instructors "teach down'' to interns? 



Career Exploration 

1. Are efforts made to fit career choices to freely expressed 
preferences? 

2. Is the happiness of the intern a major concern in choosing 
specialization, or is some notion of what is best for the 
program? 

3. Are genuine efforts made to find the best representatives of 
all types of career possibilities to use as models? 

4. Do non-college preparation interns feel apologetic about 
their preferences and somehow pressured in ways the academics 
are not? 



Career Specialization 

1. Do interns feel they are engaged in a real, legitimate 
educational experience? (For example, do they refer to 
themselves as being in school?) 

2. Do staff feel they are welfare worker-types helping the 
disadvantaged or teachers dealing with normal kids? 

3. How do interns anticipate the graduation ceremony? 

4. What kinds of disagreements erupt between interns and staff, 
and how are they adjudicated? 



FOCUS ON SOCIAL STRUCTURE 



Recruitment 

1. Who among the recruiters are most successful; i.e., what 
personal qiialifications do they exhibit? 

2. Are certain potential interns assured that they will "fit 
in well" to certain positions? 
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3; What feelings do parents and interns express about rankings 
"in the program and about authority structures in general? 



Intake and Orientation 

1. How are role-expectations defined and articulated in early 
contacts? 

2. How carefully and accurately is the social structure ex- 
plained in the early stages of the program? 

3. Is sufficient, realistic exposure given to the entire pro- 
gram early on so that role-expectations can be clearly 
divined? 

4. Are role-expectations consistently supported so that interns 
and staff are not continually surprised? 

5. Are real authority structures isomorphic with apparent ones? 



Career Awareness 

1. How do the staff define the relationship between themselves 
and the interns? (That is, do they have a colleague model, a 
superiority- inferiority model, a giver-recipient model, or 
some other model? 

2. What is the relative ranking given various academic instructors? 

3. Which staff can be trusted; which must one be careful with? 

4. Are interns considered bright and not-so-bright isolated and 
treated differently? 

5. Who makes decisions about what careers to be presented when? 



Career Exploration 

(Most of the questions posed under career awareness are applicable 
here.) 



Career Specialization 

1. How do the role models interns adopt in the CIP serve them 
on the job? 

IGJ 
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2. How do interns adjust to the roles they are asked to fill 
in the world outside CIP? (Are they treated as typical 
high school graduates, or are they seen as more mature 
and sophisticated? 

3. Does the social structure of CIP provide continuing genuine 
interest and support for working interns without smothering 
them with directions or over-protection? 

General 



1. How does the social structure of CIP serve to define goals 
and objectives? 

2. How does the social structure facilitate or hinder the 
realization of the CIP's stated goals and objectives? 

3. How is the social structured-particular ly role-expectations 
and status rankings which interns must contend with— • 
isomorphic with, and thus preparatory for, the outside 
world graduates must function in? (In other words, how 
does the social structure of the CIP contribute to a re- 
levant educational experience for intems?) 

4. How would changes in the social structure affect the program? 

5. How resistant or amenable to change is the existing social 
structure? 



-175- 



APPENDIX III 



COSTS PER INTERN 



During the Career Intern Program's developmental phase (January 
1974 to February 1975), the operations costs per intern were re- 
ported at $3,935 as of June 30, 1974 (see Exhibit 1). Included 
in this figure are certain one-time start-up costs. On February 28, 
1975, operations costs were reported as $2,758 per intern (Exhibit 
2). This decline in costs can be attributed primarily to increased 
program efficiency, reduction in program staff, and consolidation 
of functions. 



Despite inflation, the summative phase of CIP (March 1, 1975 - 
February 29, 1976) may result in an even lower operations cost per 
intern. Intern enrollment has increased from 100 to 220. If dur- 
ing this period the number of interns remains constant at the 220 
level and program staff is not increased, the costs per intern will 
be in the $1,650 to $1,750 range, using the same mechanics as illus- 
trated in Exhibits 1 and 2 to arrive at the cost figure. Enrollment 
will continue to increase until OIC reaches the most cost-effective 
position without diluting efficiency. 
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